00000001:02000400:1.0F:1789517876.479515:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789517897.052273:0:3514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789517898.737453:0:3576:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 635 MB/s 00000001:01000000:2.0:1789517898.990600:0:3576:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 861 MB/s 00000001:01000000:1.0:1789517899.240759:0:3576:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4203 MB/s 00000020:02000000:3.0:1789517900.027456:0:3605:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g97904ba 00000400:02000000:3.0:1789517901.123044:0:3621:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.143@tcp [8/256/0/180] 00008000:02000000:3.0:1789517905.363208:0:3770:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789517968.725803:0:5739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789517984.655819:0:6489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789517984.655829:0:6489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789517984.655831:0:6489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789517984.655999:0:6489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000fe7fd365 00000080:02000400:1.0:1789517984.656014:0:6489:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789517984.664101:0:6489:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789517984.664116:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789517984.664162:0:6489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ffaa7352) 00000020:00000080:1.0:1789517984.664182:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789517984.737136:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789517984.737234:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789517984.786372:0:6489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0F:1789517984.791016:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789517984.791040:0:6489:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789517984.791057:0:6489:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942313d0a 00000020:01000004:0.0:1789517984.791066:0:6489:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789517984.791073:0:6489:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789517984.791079:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fe7fd365 from MGS 00000020:01000004:0.0:1789517984.791083:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789517984.791106:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000df6b67e6) 00000020:00000080:0.0:1789517984.791122:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789517984.791250:0:6489:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fe7fd365 from MGS, refs=2 00080000:01000000:0.0:1789517984.791257:0:6489:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789517984.791262:0:6489:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942313d18 00000100:00100000:0.0:1789517984.791403:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789517984.791832:0:6489:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789517984.791840:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789517984.796753:0:6489:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789517984.796768:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789517984.800275:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789517984.800533:0:6489:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789517984.800541:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789517984.815135:0:6489:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789517984.815153:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789517984.817344:0:6489:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789517984.817358:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789517984.819019:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789517984.819026:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789517984.819028:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789517984.819375:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789517984.819377:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789517984.819379:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789517984.820165:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789517984.826991:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789517985.069913:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2667 MB/s 00000001:01000000:2.0:1789517985.320905:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3717 MB/s 00000001:01000000:3.0:1789517985.573491:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 492 MB/s 00000001:01000000:1.0:1789517985.831081:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 400 MB/s 00010000:00010000:0.0:1789517985.845872:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789517985.846649:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789517985.890778:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789517985.891455:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789517985.891551:0:6489:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789517985.891589:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789517985.891745:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789517985.891784:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789517985.892110:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789517985.892253:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789517985.892260:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789517985.898068:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789517985.898083:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789517985.898651:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789517985.898660:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789517985.899278:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789517985.899301:0:6489:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.143@tcp' 00000020:01000004:0.0:1789517985.899303:0:6489:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789517985.899364:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.143@tcp (typ=mgc) 00000020:00000080:0.0:1789517985.899376:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.143@tcp (000000006876a5e7) 00000020:00000080:0.0:1789517985.899391:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789517985.899496:0:6489:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b24bda52@MGC192.168.202.143@tcp: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789517985.899651:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.143@tcp-0 is initialized 00000040:01000000:0.0:1789517985.899657:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789517985.900027:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789517985.900788:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789517985.900871:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.143@tcp (uuid ecfb1fc7-85a9-4c59-b070-db791c081ea7) 00000020:00000080:3.0:1789517985.900890:0:6489:0:(genops.c:1384:class_connect()) connect: client ecfb1fc7-85a9-4c59-b070-db791c081ea7, cookie 0x8d0fd67942313d26 00000100:00080000:3.0:1789517985.900901:0:6489:0:(import.c:545:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789517985.900910:0:6489:0:(import.c:666:import_select_connection()) MGC192.168.202.143@tcp: import 00000000b24bda52 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789517985.900954:0:6489:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d558ef1f x1876445522559104/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789517985.900982:0:6489:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS 00000020:01000004:3.0:1789517985.901005:0:6489:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789517985.901011:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789517985.901029:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000420c2065) 00000020:00000080:3.0:1789517985.901037:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789517985.907996:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d558ef1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522559104:0@lo:250: 00000100:00100000:2.0:1789517985.908086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517985.912251:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522559104 00000100:00100000:0.0:1789517985.912269:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522559104 00000100:00100000:0.0:1789517985.912321:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789517985.912337:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000633878a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1876445522559104:12345-0@lo:250: 00010000:00080000:0.0:1789517985.912373:0:6505:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ecfb1fc7-85a9-4c59-b070-db791c081ea7@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:0.0:1789517985.912402:0:6505:0:(genops.c:1384:class_connect()) connect: client ecfb1fc7-85a9-4c59-b070-db791c081ea7, cookie 0x8d0fd67942313d34 00000100:00080000:0.0:1789517985.912573:0:6505:0:(import.c:65:import_set_state_nolock()) 0000000039c7af87 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789517985.912689:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000633878a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:3636:x1876445522559104:12345-0@lo:250: Request processed in 352us (4603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517985.912701:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789517985.913645:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789517985.913659:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.143@tcp: connect to target with instance 0 00000100:00080000:0.0:1789517985.913666:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789517985.913671:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789517985.913674:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000b24bda52 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789517985.913677:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789517985.913686:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789517985.913692:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d558ef1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522559104:0@lo:250: 00000100:00100000:3.0:1789517985.964622:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789517985.965845:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789517985.965855:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789517985.967081:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789517985.967094:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789517985.971720:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789517985.971741:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789517985.972655:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789517985.973084:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789517985.973092:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789517985.973801:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789517985.973809:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789517986.037113:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789517986.037322:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789517986.037329:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789517986.038980:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789517986.038993:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789517986.040036:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789517986.040246:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789517986.040251:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789517986.040964:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789517986.040973:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789517986.041800:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789517986.041973:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789517986.041978:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789517986.042848:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789517986.042856:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789517986.045933:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789517986.046133:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789517986.046140:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789517986.047143:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789517986.047151:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789517986.086758:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789517986.086976:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789517986.086992:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789517986.088997:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789517986.089012:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789517986.091129:0:6489:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789517986.091144:0:6489:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789517986.099286:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789517986.099318:0:6489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789517986.099336:0:6489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789517986.099450:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789517986.099737:0:6489:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789517986.099742:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789517986.099744:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789517986.099746:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789517986.099747:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789517986.099748:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789517986.099750:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789517986.099751:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789517986.099753:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789517986.099755:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789517986.099756:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789517986.099758:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789517986.099759:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789517986.099772:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789517986.099774:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789517986.099775:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789517986.099777:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789517986.099777:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789517986.099779:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789517986.099779:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789517986.099781:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789517986.099782:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789517986.099782:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789517986.099783:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789517986.099784:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789517986.099785:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789517986.099812:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789517986.099830:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f03b7885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559232:0@lo:253: 00000100:00100000:3.0:1789517986.099932:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789517986.099990:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cdb181e going to sleep for 11 seconds 00000100:00100000:0.0:1789517986.100089:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522559232 00000100:00100000:0.0:1789517986.100098:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522559232 00000100:00100000:0.0:1789517986.100142:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789517986.100151:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e1101b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6489:x1876445522559232:12345-0@lo:253: 20000000:01000000:0.0:1789517986.100197:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789517986.100200:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789517986.100611:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789517986.100833:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789517986.101120:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789517986.103849:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789517986.104005:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789517986.104009:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789517986.104017:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789517986.104020:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789517986.104032:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789517986.104232:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789517986.106144:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789517986.106172:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789517986.106199:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789517986.106214:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789517986.106227:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789517986.106299:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789517986.106306:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789517986.106319:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789517986.106338:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789517986.106351:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789517986.106365:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789517986.106379:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789517986.106391:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789517986.106419:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789517986.106425:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789517986.106432:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789517986.106647:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789517986.106658:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789517986.106672:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789517986.106685:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789517986.106698:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789517986.106706:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789517986.106730:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789517986.106738:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789517986.106748:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789517986.106792:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789517986.106808:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789517986.106818:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789517986.106854:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789517986.106862:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789517986.106874:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789517986.106887:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789517986.106936:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789517986.106955:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789517986.106961:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789517986.111242:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789517986.113146:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789517986.113184:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.143@tcp for mdt 20000000:01000000:1.0:1789517986.113187:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789517986.113203:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789517986.113209:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789517986.113222:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789517986.113227:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:1.0:1789517986.113256:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789517986.113265:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789517986.113277:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789517986.113290:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789517986.113318:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789517986.113321:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789517986.113338:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789517986.113404:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789517986.113407:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789517986.114070:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789517986.115814:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789517986.115844:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789517986.115857:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789517986.115864:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789517986.115867:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789517986.117111:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789517986.117285:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789517986.117305:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789517986.117345:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1789517986.117358:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789517986.117361:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789517986.117366:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789517986.117368:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789517986.117374:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789517986.117380:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789517986.118549:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789517986.118729:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789517986.133055:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789517986.133093:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789517986.133110:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789517986.133131:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789517986.133154:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133192:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133203:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133209:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133216:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133222:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133229:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003bafc8c9 already unused, calling callback (000000000903ef61) 00010000:00010000:1.0:1789517986.133232:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133239:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133252:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133259:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.133265:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313d3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789517986.133292:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789517986.151701:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e1101b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6489:x1876445522559232:12345-0@lo:253: Request processed in 51543us (51762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.151722:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789517986.152813:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f03b7885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559232:0@lo:253: 10000000:01000000:3.0:1789517986.152833:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789517986.152836:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789517986.152839:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789517986.152840:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789517986.152841:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789517986.152842:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789517986.152843:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789517986.152844:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789517986.152846:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789517986.152847:0:6489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789517986.152849:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789517986.152850:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789517986.152871:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fe7fd365 from lustre-MDT0000 10000000:01000000:3.0:1789517986.152902:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789517986.152905:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789517986.152909:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e740dd9cd40 10000000:01000000:3.0:1789517986.152912:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789517986.152920:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e740dd9cd40 from 1 10000000:01000000:3.0:1789517986.152922:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789517986.152961:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.152972:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.152980:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789517986.152998:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f03b7885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559360:0@lo:101: 00000100:00100000:3.0:1789517986.153044:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789517986.153125:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000007136f380 going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.156663:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522559360 00000100:00100000:2.0:1789517986.156679:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522559360 00000100:00100000:2.0:1789517986.156769:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789517986.156781:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6732d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6489:x1876445522559360:12345-0@lo:101: 00010000:00010000:2.0:1789517986.156808:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789517986.156830:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313d42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517986.156858:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517986.156870:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517986.156879:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000673d4675, rc 0) 00000100:00100000:2.0:1789517986.156961:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6732d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:6489:x1876445522559360:12345-0@lo:101: Request processed in 182us (3915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.156969:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789517986.156993:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f03b7885 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559360:0@lo:101: 00010000:00010000:0.0:1789517986.157014:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.157024:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789517986.157105:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e504075e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559488:0@lo:501: 00000100:00100000:0.0:1789517986.157149:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517986.157212:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094e18fd2 going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.157988:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522559488 00000100:00100000:2.0:1789517986.157997:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522559488 00000100:00100000:2.0:1789517986.158034:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789517986.158039:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051a7827a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:6489:x1876445522559488:12345-0@lo:501: 00000100:00100000:2.0:1789517986.158134:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051a7827a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:6489:x1876445522559488:12345-0@lo:501: Request processed in 94us (985us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789517986.158142:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789517986.158160:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e504075e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559488:0@lo:501: 10000000:01000000:0.0:1789517986.158192:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789517986.158208:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.158215:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789517986.158222:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e7439644800 10000000:01000000:0.0:1789517986.158225:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789517986.158228:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e7439644800 10000000:01000000:0.0:1789517986.158229:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789517986.158231:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e7439644800 from 1 10000000:01000000:0.0:1789517986.158233:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789517986.158251:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000002204ced0/0x8d0fd67942313d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.158255:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000002204ced0/0x8d0fd67942313d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.158261:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000002204ced0/0x8d0fd67942313d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789517986.158271:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e504075e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559616:0@lo:101: 00000100:00100000:0.0:1789517986.158291:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517986.158603:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094e18fd2 going to sleep for 11 seconds 00000100:00100000:3.0:1789517986.158741:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522559616 00000100:00100000:3.0:1789517986.158747:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522559616 00000100:00100000:3.0:1789517986.158823:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789517986.158829:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e36e1bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:6489:x1876445522559616:12345-0@lo:101: 00010000:00010000:3.0:1789517986.158837:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789517986.158848:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080491409/0x8d0fd67942313d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313d50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.158861:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080491409/0x8d0fd67942313d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313d50 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.158867:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080491409/0x8d0fd67942313d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313d50 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.158872:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080491409, rc 0) 00000100:00100000:3.0:1789517986.158906:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e36e1bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+7:6489:x1876445522559616:12345-0@lo:101: Request processed in 79us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789517986.158910:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789517986.158979:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e504075e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559616:0@lo:101: 00010000:00010000:1.0:1789517986.158992:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000002204ced0/0x8d0fd67942313d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.159001:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000002204ced0/0x8d0fd67942313d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789517986.159014:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789517986.159029:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000002204ced0/0x8d0fd67942313d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.159036:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000002204ced0/0x8d0fd67942313d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789517986.159042:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789517986.159046:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789517986.159050:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e7439644800 10000000:01000000:1.0:1789517986.159053:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789517986.159056:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789517986.159058:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789517986.159089:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.159096:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.159103:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789517986.159119:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559744:0@lo:101: 00000100:00100000:1.0:1789517986.159155:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517986.159175:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053ff402c going to sleep for 11 seconds 00000100:00100000:3.0:1789517986.159191:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522559744 00000100:00100000:3.0:1789517986.159196:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522559744 00000100:00100000:3.0:1789517986.159243:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789517986.159247:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000097943f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+7:6489:x1876445522559744:12345-0@lo:101: 00010000:00010000:3.0:1789517986.159252:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789517986.159257:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.159267:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.159281:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.159285:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000107b2dfb, rc 0) 00000100:00100000:3.0:1789517986.159318:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000097943f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+8:6489:x1876445522559744:12345-0@lo:101: Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789517986.159322:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789517986.159381:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559744:0@lo:101: 00010000:00010000:1.0:1789517986.159391:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.159398:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789517986.159444:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559872:0@lo:501: 00000100:00100000:1.0:1789517986.159497:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517986.159524:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522559872 00000100:00100000:1.0:1789517986.159525:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053ff402c going to sleep for 11 seconds 00000100:00100000:0.0:1789517986.159535:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522559872 00000100:00100000:0.0:1789517986.159554:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789517986.159558:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9066aae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+8:6489:x1876445522559872:12345-0@lo:501: 00000100:00100000:0.0:1789517986.159671:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9066aae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6489:x1876445522559872:12345-0@lo:501: Request processed in 107us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517986.159676:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789517986.162042:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522559872:0@lo:501: 00000100:00100000:1.0:1789517986.162107:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560000:0@lo:503: 00000100:00100000:1.0:1789517986.162186:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517986.162238:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053ff402c going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.162380:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560000 00000100:00100000:2.0:1789517986.162390:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560000 00000100:00100000:2.0:1789517986.162457:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789517986.162513:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc9c3b44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6489:x1876445522560000:12345-0@lo:503: 00000100:00100000:2.0:1789517986.162628:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc9c3b44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6489:x1876445522560000:12345-0@lo:503: Request processed in 117us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.162636:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789517986.162663:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560000:0@lo:503: 00000100:00100000:3.0:1789517986.163169:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b646a47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6535:1876445522560128:0@lo:502: 00000100:00100000:3.0:1789517986.163211:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789517986.163247:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 00000000689f0f26 going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.163436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560128 00000100:00100000:2.0:1789517986.163443:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560128 00000100:00100000:3.0:1789517986.165241:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789517986.165272:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a91e9ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6535:x1876445522560128:12345-0@lo:502: 00000100:00100000:2.0:1789517986.165637:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b646a47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6535:1876445522560128:0@lo:502: 00000020:01000000:2.0:1789517986.165678:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789517986.165690:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789517986.165693:0:6535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789517986.165697:0:6535:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789517986.165700:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789517986.165724:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000867769f1) 00000020:00000080:2.0:1789517986.165742:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789517986.165748:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789517986.165860:0:6535:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789517986.165866:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942313d73 00000020:00000080:2.0:1789517986.166082:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789517986.166087:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789517986.166091:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789517986.166092:0:6535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789517986.166094:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789517986.166098:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789517986.166099:0:6535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789517986.166102:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789517986.166108:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a59540a5) 00000020:00000080:2.0:1789517986.166118:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789517986.166121:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789517986.166123:0:6535:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789517986.166126:0:6535:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789517986.166131:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789517986.166172:0:6535:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fe7fd365 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789517986.166184:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b078688f) 00000020:00000080:2.0:1789517986.166190:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789517986.166251:0:6535:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789517986.166256:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd67942313d88 00000020:00000080:2.0:1789517986.166362:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789517986.166374:0:6535:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789517986.166379:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8d0fd67942313d8f 00080000:01000000:2.0:1789517986.166384:0:6535:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789517986.166388:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942313d96 00080000:10000000:2.0:1789517986.167004:0:6535:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789517986.167200:0:6535:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 00000100:00100000:3.0:1789517986.167842:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a91e9ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6535:x1876445522560128:12345-0@lo:502: Request processed in 2582us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789517986.167856:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 40000000:02000000:3.0:1789517986.175273:0:6535:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789517986.306866:0:6535:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789517986.307620:0:6535:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789517986.311244:0:6535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789517986.312951:0:6535:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789517986.331838:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fa2fe125) 00000020:00000080:3.0:1789517986.331867:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789517986.333586:0:6535:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789517986.333605:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942313da4 00000020:00000080:3.0:1789517986.342314:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789517986.343240:0:6535:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789517986.348183:0:6535:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789517986.351331:0:6535:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789517986.353342:0:6535:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789517986.355376:0:6535:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789517986.356984:0:6535:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1789517986.358883:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8d0fd67942313dab 00000020:00000080:0.0:1789517986.359369:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789517986.359381:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789517986.359386:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789517986.359388:0:6535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789517986.359391:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789517986.359394:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789517986.359395:0:6535:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789517986.359398:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789517986.359400:0:6535:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789517986.359403:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789517986.359404:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789517986.359406:0:6535:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789517986.359408:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789517986.359412:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789517986.359413:0:6535:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789517986.359418:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789517986.359663:0:6535:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789517986.359732:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6535:1876445522560256:0@lo:502: 00000100:00100000:0.0:1789517986.359832:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517986.359878:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c81b3ef7 going to sleep for 11 seconds 00000100:00100000:1.0:1789517986.359951:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560256 00000100:00100000:1.0:1789517986.359960:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560256 00000100:00100000:1.0:1789517986.360012:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789517986.360020:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004297e3e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6535:x1876445522560256:12345-0@lo:502: 00000100:00100000:1.0:1789517986.360147:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004297e3e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6535:x1876445522560256:12345-0@lo:502: Request processed in 127us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789517986.360165:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789517986.360289:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6535:1876445522560256:0@lo:502: 00000020:01000000:0.0:1789517986.360314:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789517986.360320:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789517986.360322:0:6535:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789517986.360325:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789517986.360622:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789517986.360644:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789517986.360696:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.360709:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789517986.360717:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7439644800 from 1 10000000:01000000:1.0:1789517986.360720:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789517986.360748:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.360756:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.360776:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789517986.360791:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560384:0@lo:101: 00000100:00100000:1.0:1789517986.360825:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517986.360862:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8018e1a going to sleep for 11 seconds 00000100:00100000:0.0:1789517986.360912:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560384 00000100:00100000:0.0:1789517986.360918:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560384 00000100:00100000:0.0:1789517986.360948:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789517986.360954:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000795a8514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:6489:x1876445522560384:12345-0@lo:101: 00010000:00010000:0.0:1789517986.360962:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789517986.360976:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.360996:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.361005:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.361012:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d140116c, rc 0) 00000100:00100000:0.0:1789517986.361038:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000795a8514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:6489:x1876445522560384:12345-0@lo:101: Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517986.361043:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789517986.361105:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560384:0@lo:101: 00010000:00010000:1.0:1789517986.361118:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.361126:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789517986.361696:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560512:0@lo:256: 00000100:00100000:1.0:1789517986.361737:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517986.361754:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8018e1a going to sleep for 11 seconds 00000100:00100000:1.0:1789517986.361782:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560512 00000100:00100000:1.0:1789517986.361787:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560512 00000100:00100000:1.0:1789517986.361813:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789517986.361819:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000030fb0a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:6489:x1876445522560512:12345-0@lo:256: 20000000:01000000:1.0:1789517986.361833:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789517986.361839:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789517986.361902:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000030fb0a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:6489:x1876445522560512:12345-0@lo:256: Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789517986.361908:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789517986.361938:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560512:0@lo:256: 10000000:01000000:1.0:1789517986.362523:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789517986.362917:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.362930:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789517986.362939:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7439644800 from 1 10000000:01000000:1.0:1789517986.362941:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789517986.362972:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.362979:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.363782:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789517986.363808:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560640:0@lo:101: 00000100:00100000:1.0:1789517986.363881:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789517986.363931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560640 00000100:00100000:2.0:1789517986.363939:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560640 00000100:00100000:1.0:1789517986.363948:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8018e1a going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.363991:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789517986.364000:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049e999dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:6489:x1876445522560640:12345-0@lo:101: 00010000:00010000:2.0:1789517986.364015:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789517986.364030:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313dc0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517986.364053:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517986.364062:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517986.364072:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001dca7715, rc 0) 00000100:00100000:2.0:1789517986.364119:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049e999dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:6489:x1876445522560640:12345-0@lo:101: Request processed in 120us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.364125:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789517986.364200:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560640:0@lo:101: 00010000:00010000:1.0:1789517986.364212:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.364217:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789517986.364264:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560768:0@lo:501: 00000100:00100000:1.0:1789517986.364280:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517986.364296:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8018e1a going to sleep for 11 seconds 00000100:00100000:0.0:1789517986.364408:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560768 00000100:00100000:0.0:1789517986.364412:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560768 00000100:00100000:0.0:1789517986.364448:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789517986.364454:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cdba8919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:6489:x1876445522560768:12345-0@lo:501: 00000100:00100000:0.0:1789517986.364681:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cdba8919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:6489:x1876445522560768:12345-0@lo:501: Request processed in 227us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517986.364689:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789517986.364711:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560768:0@lo:501: 00000100:00100000:1.0:1789517986.364735:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560896:0@lo:503: 00000100:00100000:1.0:1789517986.364783:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517986.364808:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8018e1a going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.364859:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522560896 00000100:00100000:2.0:1789517986.364863:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522560896 00000100:00100000:2.0:1789517986.364929:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789517986.364936:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049776c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:6489:x1876445522560896:12345-0@lo:503: 00000040:00080000:2.0:1789517986.364967:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789517986.365013:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049776c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:6489:x1876445522560896:12345-0@lo:503: Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.365025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789517986.365099:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522560896:0@lo:503: 00000040:00080000:1.0:1789517986.366022:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789517986.366929:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789517986.366971:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789517986.366985:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.366999:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789517986.367066:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789517986.367070:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e7439644800 10000000:01000000:3.0:1789517986.367073:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e7439644800 10000000:01000000:3.0:1789517986.367077:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789517986.367083:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7439644800 from 1 10000000:01000000:3.0:1789517986.367086:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789517986.367122:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.367137:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.367149:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789517986.367170:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004207bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561024:0@lo:101: 00000100:00100000:3.0:1789517986.367228:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789517986.367320:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000002308e767 going to sleep for 11 seconds 00000100:00100000:0.0:1789517986.368773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561024 00000100:00100000:0.0:1789517986.368786:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561024 00000100:00100000:0.0:1789517986.368834:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789517986.368840:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e0df4f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:6489:x1876445522561024:12345-0@lo:101: 00010000:00010000:0.0:1789517986.368856:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789517986.368873:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313dce expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.368893:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313dce expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.368901:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313dce expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.368907:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fd8cb36, rc 0) 00000100:00100000:0.0:1789517986.368965:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e0df4f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6489:x1876445522561024:12345-0@lo:101: Request processed in 125us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517986.368971:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789517986.369002:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004207bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561024:0@lo:101: 00010000:00010000:3.0:1789517986.369019:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.369027:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789517986.369109:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004207bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561152:0@lo:501: 00000100:00100000:3.0:1789517986.369147:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789517986.369183:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000002308e767 going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.369194:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561152 00000100:00100000:2.0:1789517986.369198:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561152 00000100:00100000:2.0:1789517986.369226:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789517986.369232:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ddda68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6489:x1876445522561152:12345-0@lo:501: 00000100:00100000:2.0:1789517986.369340:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ddda68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6489:x1876445522561152:12345-0@lo:501: Request processed in 108us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.369347:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789517986.369365:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004207bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561152:0@lo:501: 00000100:00100000:3.0:1789517986.369389:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004207bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561280:0@lo:503: 00000100:00100000:3.0:1789517986.369428:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789517986.369446:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000002308e767 going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.369646:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561280 00000100:00100000:2.0:1789517986.369650:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561280 00000100:00100000:2.0:1789517986.369670:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789517986.369673:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c19ce9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6489:x1876445522561280:12345-0@lo:503: 00000100:00100000:2.0:1789517986.369741:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c19ce9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6489:x1876445522561280:12345-0@lo:503: Request processed in 66us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.369748:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789517986.369798:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004207bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561280:0@lo:503: 00000100:00100000:0.0:1789517986.370277:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6540:1876445522561408:0@lo:502: 00000100:00100000:0.0:1789517986.370317:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517986.370699:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dccd4d48 going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.370788:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561408 00000100:00100000:2.0:1789517986.370794:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561408 00000100:00100000:2.0:1789517986.370860:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789517986.370867:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008ab3edb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6540:x1876445522561408:12345-0@lo:502: 00000100:00100000:2.0:1789517986.370958:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008ab3edb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6540:x1876445522561408:12345-0@lo:502: Request processed in 91us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.370966:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789517986.371028:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6540:1876445522561408:0@lo:502: 00000020:01000004:0.0:1789517986.371087:0:6540:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789517986.371102:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c981c2e1) 00000020:00000080:0.0:1789517986.371136:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789517986.371222:0:6540:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fe7fd365 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789517986.371227:0:6540:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fe7fd365 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789517986.371229:0:6540:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fe7fd365 4 00010000:00080000:0.0:1789517986.371255:0:6540:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052f43d07@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789517986.372804:0:6540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789517986.375885:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789517986.375929:0:6540:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789517986.375941:0:6540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8d0fd67942313de3 00000100:00080000:0.0:1789517986.375952:0:6540:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789517986.375962:0:6540:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052f43d07 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789517986.375998:0:6540:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a1768b65 x1876445522561536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789517986.376027:0:6540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789517986.376186:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001eb825a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6540:1876445522561664:0@lo:502: 00000100:00100000:0.0:1789517986.376257:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517986.376293:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561664 00000100:00100000:0.0:1789517986.376300:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561664 00000100:00100000:0.0:1789517986.376337:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789517986.376345:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b2adbe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6540:x1876445522561664:12345-0@lo:502: 00000100:00100000:0.0:1789517986.376451:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b2adbe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6540:x1876445522561664:12345-0@lo:502: Request processed in 107us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517986.376459:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789517986.376533:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6abd10 going to sleep for 11 seconds 00000100:00100000:0.0:1789517986.376556:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001eb825a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6540:1876445522561664:0@lo:502: 00000040:00080000:0.0:1789517986.376580:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1789517986.376801:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522561536:0@lo:38: 00000100:00100000:3.0:1789517986.376843:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789517986.376892:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789517986.376913:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789517986.376933:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789517986.376943:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789517986.376993:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789517986.376995:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789517986.376997:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789517986.376998:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789517986.376999:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789517986.377001:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789517986.377002:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789517986.377003:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789517986.377005:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789517986.377006:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789517986.377012:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789517986.377014:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789517986.377017:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789517986.377019:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789517986.377021:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789517986.377022:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789517986.377023:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789517986.377023:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789517986.377024:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789517986.377025:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789517986.377026:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789517986.377027:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789517986.377028:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789517986.377029:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789517986.377029:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789517986.377043:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789517986.377051:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0768f58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561792:0@lo:253: 00000100:00100000:3.0:1789517986.377080:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789517986.377100:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c05958a going to sleep for 11 seconds 00000100:00100000:2.0:1789517986.377103:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561792 00000100:00100000:2.0:1789517986.377108:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561792 00000100:00100000:2.0:1789517986.377143:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789517986.377151:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000871499ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6489:x1876445522561792:12345-0@lo:253: 20000000:01000000:2.0:1789517986.377182:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789517986.377196:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789517986.378595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561536 00000100:00100000:0.0:1789517986.378612:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561536 00000100:00100000:0.0:1789517986.378642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789517986.378648:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004207bf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1876445522561536:12345-0@lo:38: 00000100:00100000:0.0:1789517986.382110:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004207bf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1876445522561536:12345-0@lo:38: Request processed in 3454us (5260us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789517986.382127:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789517986.382225:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789517986.382234:0:3636:0:(import.c:65:import_set_state_nolock()) 0000000052f43d07 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789517986.382237:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789517986.382241:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522561536:0@lo:38: 20000000:01000000:2.0:1789517986.392588:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789517986.392633:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789517986.392974:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000871499ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6489:x1876445522561792:12345-0@lo:253: Request processed in 15820us (15890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517986.392998:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789517986.393116:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0768f58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6489:1876445522561792:0@lo:253: 10000000:01000000:3.0:1789517986.393130:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789517986.393133:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789517986.393136:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789517986.393137:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789517986.393138:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789517986.393140:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789517986.393141:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789517986.393142:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789517986.393144:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789517986.393145:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789517986.393147:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789517986.393149:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789517986.393151:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789517986.393165:0:6489:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789517986.393659:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789517986.393664:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789517986.393684:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.393700:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.393707:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.393899:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.393915:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 11 pid: 6507 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789517986.393929:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522561920:0@lo:104: 00000100:00100000:0.0:1789517986.393973:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517986.394115:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set 000000008198dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789517986.394176:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522561920 00000100:00100000:1.0:1789517986.394185:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522561920 00000100:00100000:1.0:1789517986.394413:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789517986.394424:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001eb825a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522561920:12345-0@lo:104: 00010000:00010000:1.0:1789517986.394443:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.394512:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789517986.394516:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001eb825a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522561920:12345-0@lo:104: Request processed in 96us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789517986.394521:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789517986.394593:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1768b65 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522561920:0@lo:104: 00010000:00010000:0.0:1789517986.394606:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.394659:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789517986.394663:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.394668:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a88cbc9 already unused, calling callback (00000000505ff6fc) 10000000:00010000:1.0:1789517986.394670:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.394675:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789517986.394679:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789517986.394682:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789517986.394738:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.394745:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789517986.394777:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.394784:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 000000000a88cbc9/0x8d0fd67942313db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313db9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.394816:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789517986.394818:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789517986.394819:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789517986.394896:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522562048:0@lo:103: 00000100:00100000:0.0:1789517986.394925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517986.395233:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562048 00000100:00100000:1.0:1789517986.395238:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562048 00010000:00010000:1.0:1789517986.395251:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 12 pid: 6507 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789517986.395274:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789517986.395278:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1768b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3638:x1876445522562048:12345-0@lo:103: 00010000:00010000:1.0:1789517986.395286:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789517986.395289:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 12 pid: 6507 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395296:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 12 pid: 6507 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395305:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d140116c/0x8d0fd67942313db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313db2 expref: 12 pid: 6507 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395314:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395320:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789517986.395329:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001665516s 00010000:00010000:1.0:1789517986.395332:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395343:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395347:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395350:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395353:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e9791641 already unused, calling callback (000000000903ef61) 00010000:00010000:1.0:1789517986.395355:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395360:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395367:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517986.395373:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789517986.395393:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1768b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:3638:x1876445522562048:12345-0@lo:103: Request processed in 116us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789517986.395398:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789517986.395448:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088c8c8cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522562048:0@lo:103: 00010000:00010000:0.0:1789517986.395485:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.395490:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517986.395494:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e9791641/0x8d0fd67942313dea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789517986.398603:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789517986.398834:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789517986.399648:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789517986.400096:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789517986.400296:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789517986.400444:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789517986.403443:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789517986.403922:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789517986.404134:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789517986.404295:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789517986.404513:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789517986.404689:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789517986.410295:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789517986.417428:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789517986.417724:0:6546:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789517986.418806:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789517986.418899:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789517986.419301:0:6489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789517986.419309:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789517986.419380:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789517986.420337:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:1.0:1789517986.421089:0:6545:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789517986.421096:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1789517986.421327:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789517986.421374:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789517986.423933:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789517986.426257:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789517986.426925:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000040:00080000:2.0:1789517986.428066:0:6546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1789517986.432571:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789517986.433589:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789517986.433972:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789517986.434240:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789517986.434389:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789517986.434558:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789517986.434798:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789517986.434911:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789517986.435166:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789517986.435287:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789517986.435406:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789517986.435586:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789517986.435978:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789517986.436267:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789517986.436381:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:2.0:1789517986.436592:0:6546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789517986.436654:0:6546:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789517986.436658:0:6546:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1789517986.436852:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789517986.437141:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789517986.437276:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789517986.437399:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789517986.438215:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789517986.438379:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789517986.438534:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789517986.438745:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789517986.438902:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789517986.439205:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789517986.439335:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789517986.439887:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789517986.440168:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789517986.440323:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789517986.440636:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789517986.440793:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789517986.440979:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789517986.448039:0:6489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789517986.448085:0:6489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb996419af988 00100000:10000000:0.0:1789517986.448094:0:6489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789517986.450933:0:6489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789517986.450952:0:6489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789517986.450971:0:6489:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789517986.450998:0:6489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789517986.451631:0:6489:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789517986.451832:0:6489:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789517986.870108:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789517987.897710:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789517988.918705:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789517989.941818:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789517990.813226:0:6790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789517990.966479:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789517991.414301:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1789517991.414328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789517991.414333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789517991.414336:0:36:0:(import.c:65:import_set_state_nolock()) 0000000052f43d07 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789517991.414361:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052f43d07 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789517991.414383:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000024715440 x1876445522562304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789517991.417989:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024715440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522562304:0@lo:38: 00000100:00100000:1.0:1789517991.418161:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789517991.418312:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562304 00000100:00100000:2.0:1789517991.418322:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562304 00000100:00100000:2.0:1789517991.418373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789517991.418381:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007daca021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1876445522562304:12345-0@lo:38: 00010000:00080000:2.0:1789517991.418411:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1789517991.418582:0:6515:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8d0fd67942313df1 00000004:00100000:2.0:1789517991.418628:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789517991.418793:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000034ac0bfa : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789517991.418864:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007daca021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876445522562304:12345-0@lo:38: Request processed in 483us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789517991.418872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789517991.418899:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000935db548 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522562176:0@lo:400: 00010000:00080000:0.0:1789517991.418948:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000024715440 x1876445522562304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789517991.419129:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789517991.419139:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789517991.419144:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789517991.419146:0:3636:0:(import.c:65:import_set_state_nolock()) 0000000052f43d07 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789517991.419153:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024715440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522562304:0@lo:38: 00000100:00100000:2.0:1789517991.419243:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517991.419271:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562176 00000100:00100000:0.0:1789517991.419277:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562176 00000100:00100000:0.0:1789517991.419327:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789517991.419335:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cbac2486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:3640:x1876445522562176:12345-0@lo:400: 00000100:00100000:0.0:1789517991.419376:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cbac2486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:3640:x1876445522562176:12345-0@lo:400: Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517991.419382:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789517991.419795:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000935db548 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522562176:0@lo:400: 00000020:00000004:2.0:1789517991.658511:0:6842:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789517991.658704:0:6842:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789517991.996161:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789517992.437585:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789517992.437609:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7439644800 from 3 10000000:01000000:2.0:1789517992.437615:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789517992.437671:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517992.437684:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517992.437726:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789517992.437751:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000935db548 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522562432:0@lo:101: 00000100:00100000:2.0:1789517992.437827:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789517992.437896:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023c2baa0 going to sleep for 11 seconds 00000100:00100000:0.0:1789517992.438162:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562432 00000100:00100000:0.0:1789517992.438173:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562432 00000100:00100000:0.0:1789517992.438233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789517992.438242:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb334eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:6509:x1876445522562432:12345-0@lo:101: 00010000:00010000:0.0:1789517992.438259:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789517992.438273:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313df8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517992.438295:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517992.438318:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789517992.438339:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d140116c, rc 0) 00000100:00100000:0.0:1789517992.438403:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb334eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6509:x1876445522562432:12345-0@lo:101: Request processed in 162us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517992.438410:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789517992.438733:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000935db548 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522562432:0@lo:101: 00010000:00010000:2.0:1789517992.438748:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789517992.438755:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789517992.438808:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000935db548 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522562560:0@lo:256: 00000100:00100000:2.0:1789517992.438842:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789517992.438866:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023c2baa0 going to sleep for 11 seconds 00000100:00100000:1.0:1789517992.439000:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562560 00000100:00100000:1.0:1789517992.439006:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562560 00000100:00100000:1.0:1789517992.439034:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789517992.439039:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000256b8baa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6509:x1876445522562560:12345-0@lo:256: 20000000:01000000:1.0:1789517992.439054:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789517992.439071:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789517992.439075:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789517992.439156:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000256b8baa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:6509:x1876445522562560:12345-0@lo:256: Request processed in 117us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789517992.439162:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789517992.439237:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000935db548 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522562560:0@lo:256: 10000000:01000000:1.0:1789517992.439274:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789517992.439281:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517992.439288:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789517993.013941:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789517994.037875:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789517994.655895:0:6944:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789517994.656122:0:6944:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789517995.064181:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789517996.087929:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789517996.535381:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e535c14e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522562816:0@lo:400: 00000100:00100000:0.0:1789517996.535513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789517996.535605:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562816 00000100:00100000:1.0:1789517996.535616:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562816 00000100:00100000:1.0:1789517996.535690:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789517996.535699:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062506e8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522562816:12345-0@lo:400: 00000100:00100000:1.0:1789517996.535759:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062506e8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522562816:12345-0@lo:400: Request processed in 62us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789517996.535767:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789517996.535795:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e535c14e x1876445522562816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789517996.535812:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e535c14e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522562816:0@lo:400: 00000100:00100000:2.0:1789517996.535891:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016dd03db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522562688:0@lo:400: 00000100:00100000:2.0:1789517996.535935:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789517996.536008:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562688 00000100:00100000:0.0:1789517996.536013:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562688 00000100:00100000:0.0:1789517996.536042:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789517996.536048:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8e706aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3640:x1876445522562688:12345-0@lo:400: 00000100:00100000:0.0:1789517996.536101:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8e706aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3640:x1876445522562688:12345-0@lo:400: Request processed in 45us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789517996.536108:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789517996.536310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016dd03db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522562688:0@lo:400: 00010000:00010000:0.0:1789517997.113937:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789517998.133756:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789517999.157679:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518000.186856:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518001.206363:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518001.654283:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067d85fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522563072:0@lo:400: 00000100:00100000:1.0:1789518001.654368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518001.654457:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563072 00000100:00100000:1.0:1789518001.654489:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563072 00000100:00100000:1.0:1789518001.654539:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518001.654548:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087d3d55e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522563072:12345-0@lo:400: 00000100:00100000:1.0:1789518001.654603:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087d3d55e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522563072:12345-0@lo:400: Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518001.654611:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789518001.654671:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000067d85fa9 x1876445522563072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518001.654686:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067d85fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522563072:0@lo:400: 00000100:00100000:3.0:1789518001.654770:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518001.654780:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bcdf330 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522562944:0@lo:400: 00000100:00100000:3.0:1789518001.654816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518001.655316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522562944 00000100:00100000:1.0:1789518001.655323:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522562944 00000100:00100000:1.0:1789518001.655366:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518001.655373:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe36c31b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3637:x1876445522562944:12345-0@lo:400: 00000100:00100000:1.0:1789518001.655416:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe36c31b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3637:x1876445522562944:12345-0@lo:400: Request processed in 44us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518001.655435:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518001.655510:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bcdf330 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522562944:0@lo:400: 00010000:00010000:3.0:1789518002.233783:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518003.253689:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518004.278802:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518005.302685:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518006.325919:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518006.348794:0:7442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789518006.348800:0:7442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789518006.348801:0:7442:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789518006.349167:0:7442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000278db442 00000020:01000004:0.0:1789518006.349189:0:7442:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1789518006.349204:0:7442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789518006.349222:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000053bb29ec) 00000020:00000080:0.0:1789518006.351141:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789518006.449193:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1789518006.450560:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789518006.497681:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789518006.497974:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789518006.497988:0:7442:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789518006.498726:0:7442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942313e0d 00000020:01000004:2.0:1789518006.498748:0:7442:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789518006.498778:0:7442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789518006.498782:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789518006.498790:0:7442:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789518006.498835:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789518006.498840:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789518006.536739:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789518006.536789:0:7442:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.143@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789518006.536794:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789518006.536796:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789518006.536798:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518006.536799:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518006.536800:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518006.536801:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518006.536803:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518006.536804:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518006.536805:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518006.536807:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518006.536808:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518006.536812:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789518006.536815:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518006.536816:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789518006.536817:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518006.536818:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518006.536819:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518006.536820:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518006.536821:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518006.536822:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518006.536823:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518006.536824:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518006.536826:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518006.536864:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789518006.536887:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c37e44a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522563200:0@lo:253: 00000100:00100000:0.0:1789518006.537000:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.537062:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000253e7c5f going to sleep for 11 seconds 00000100:00100000:1.0:1789518006.537507:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563200 00000100:00100000:1.0:1789518006.537518:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563200 00000100:00100000:1.0:1789518006.537711:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518006.537720:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c7a404a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522563200:12345-0@lo:253: 20000000:01000000:1.0:1789518006.537767:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789518006.537775:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789518006.537781:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789518006.537785:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789518006.537833:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1789518006.538097:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518006.538246:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789518006.538261:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789518006.538280:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789518006.538295:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789518006.538310:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789518006.538370:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789518006.538378:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789518006.538392:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789518006.538398:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789518006.538410:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789518006.538415:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789518006.538428:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789518006.538443:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789518006.538621:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1789518006.538633:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789518006.538646:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1789518006.538652:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789518006.538663:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1789518006.538676:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:1.0:1789518006.538690:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1789518006.538695:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789518006.538707:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789518006.538720:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789518006.538730:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789518006.538838:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1789518006.538848:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1789518006.538860:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789518006.538876:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789518006.538891:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1789518006.538897:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1789518006.538909:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789518006.538928:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789518006.538932:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1789518006.538954:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789518006.538962:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789518006.540548:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789518006.540910:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789518006.540942:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.143@tcp for mdt 20000000:01000000:1.0:1789518006.540945:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789518006.540961:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789518006.540966:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789518006.540979:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789518006.540984:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:1.0:1789518006.541002:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789518006.542207:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1789518006.542258:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1789518006.542280:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789518006.542367:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789518006.542379:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789518006.543086:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789518006.543370:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789518006.543396:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.143@tcp for mdt 20000000:01000000:2.0:1789518006.543398:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:2.0:1789518006.543408:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789518006.543413:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789518006.543421:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789518006.543424:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:2.0:1789518006.543431:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789518006.543435:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789518006.543451:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789518006.543491:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789518006.543517:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789518006.543520:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789518006.543523:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789518006.543567:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789518006.543570:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518006.544143:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518006.544168:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518006.544183:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789518006.544391:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789518006.544413:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789518006.544427:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789518006.544435:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789518006.544437:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789518006.545291:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789518006.545342:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789518006.545360:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1789518006.545948:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789518006.545980:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789518006.545995:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1789518006.546906:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789518006.546912:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789518006.547984:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789518006.548107:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789518006.548126:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789518006.548361:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789518006.548392:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789518006.548421:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789518006.548441:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789518006.548647:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789518006.548660:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789518006.548668:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789518006.549234:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789518006.549390:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789518006.560943:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789518006.561056:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561083:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561089:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561093:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313dce expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561097:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561140:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313dce expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561153:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313dce expref: 12 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.561164:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d1dab96 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876445522563328:0@lo:104: 00000100:00100000:2.0:1789518006.561233:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518006.561292:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561297:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 12 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.561317:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000837490eb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876445522563456:0@lo:104: 00000100:00100000:2.0:1789518006.561333:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518006.561350:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561355:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 12 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.561360:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d5896df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876445522563584:0@lo:104: 00000100:00100000:2.0:1789518006.561373:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.561380:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e125dd65 going to sleep for 11 seconds 00000100:00100000:1.0:1789518006.561408:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563328 00000100:00100000:1.0:1789518006.561421:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563328 00000100:00100000:1.0:1789518006.561513:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563456 00000100:00100000:1.0:1789518006.561517:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563456 00000100:00100000:1.0:1789518006.561533:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563584 00000100:00100000:1.0:1789518006.561536:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563584 00000100:00100000:2.0:1789518006.561704:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518006.561714:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fa37918 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6505:x1876445522563328:12345-0@lo:104: 00010000:00010000:2.0:1789518006.561735:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.561832:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518006.561838:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fa37918 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6505:x1876445522563328:12345-0@lo:104: Request processed in 126us (605us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518006.562567:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518006.562589:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.562601:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009eb13d0e already unused, calling callback (00000000505ff6fc) 10000000:00010000:0.0:1789518006.562604:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.562634:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518006.562641:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518006.562646:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789518006.562665:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d1dab96 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876445522563328:0@lo:104: 00010000:00010000:0.0:1789518006.562689:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.562696:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518006.562728:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.562734:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 000000009eb13d0e/0x8d0fd67942313dce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dd5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.562746:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518006.562748:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518006.562749:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518006.562979:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b41ce4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522563712:0@lo:103: 00000100:00100000:1.0:1789518006.563037:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.563145:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563712 00000100:00100000:0.0:1789518006.563152:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563712 00010000:00010000:0.0:1789518006.563185:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313dce expref: 13 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.563224:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518006.563232:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067d85fa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+13:3640:x1876445522563712:12345-0@lo:103: 00010000:00010000:0.0:1789518006.563255:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518006.563260:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313dce expref: 13 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.563280:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313dce expref: 13 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.563304:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fd8cb36/0x8d0fd67942313dd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313dce expref: 13 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.563319:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518006.563354:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067d85fa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3640:x1876445522563712:12345-0@lo:103: Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518006.563361:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518006.563556:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b41ce4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522563712:0@lo:103: 00000100:00100000:2.0:1789518006.570426:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518006.570633:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518006.570657:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df1edad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6505:x1876445522563456:12345-0@lo:104: 00010000:00010000:2.0:1789518006.570684:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.570861:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518006.570885:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df1edad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6505:x1876445522563456:12345-0@lo:104: Request processed in 244us (9550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.570891:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518006.570906:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518006.570912:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002736c086 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6505:x1876445522563584:12345-0@lo:104: 00010000:00010000:2.0:1789518006.570919:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.570957:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789518006.570961:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002736c086 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6505:x1876445522563584:12345-0@lo:104: Request processed in 50us (9587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.570967:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789518006.571005:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518006.571012:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.571020:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003bafc8c9 already unused, calling callback (00000000505ff6fc) 10000000:00010000:2.0:1789518006.571024:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.571032:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518006.571039:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518006.571045:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518006.571093:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.571179:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518006.571182:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518006.571203:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.571210:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 000000003bafc8c9/0x8d0fd67942313d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313d65 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.571222:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518006.571223:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518006.571225:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518006.571240:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016731464 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522563840:0@lo:103: 00000100:00100000:2.0:1789518006.571283:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.571362:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563840 00000100:00100000:2.0:1789518006.571373:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563840 00010000:00010000:2.0:1789518006.571399:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 12 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.571433:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518006.571440:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7af3db0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3637:x1876445522563840:12345-0@lo:103: 00010000:00010000:2.0:1789518006.571452:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518006.571457:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 12 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.571499:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 12 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.571519:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518006.571553:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7af3db0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:3637:x1876445522563840:12345-0@lo:103: Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.571565:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518006.571619:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016731464 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522563840:0@lo:103: 00010000:00010000:1.0:1789518006.572454:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000107b2dfb/0x8d0fd67942313d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313d5e expref: 11 pid: 6507 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.572495:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000837490eb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876445522563456:0@lo:104: 00010000:00010000:2.0:1789518006.573016:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518006.573020:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518006.573022:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518006.573114:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573125:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edaccc12 already unused, calling callback (00000000505ff6fc) 10000000:00010000:0.0:1789518006.573129:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573137:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518006.573143:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518006.573149:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518006.573197:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573217:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518006.573250:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573256:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 00000000edaccc12/0x8d0fd67942313d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313d49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573273:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518006.573274:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518006.573276:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518006.573313:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518006.573331:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033023c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522563968:0@lo:103: 00000100:00100000:3.0:1789518006.573401:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.573526:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522563968 00000100:00100000:0.0:1789518006.573534:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522563968 00010000:00010000:0.0:1789518006.573559:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 11 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.573610:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518006.573619:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0768f58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:3637:x1876445522563968:12345-0@lo:103: 00010000:00010000:0.0:1789518006.573633:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518006.573637:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 11 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573649:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 11 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573668:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573677:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573705:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573712:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573718:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573724:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573730:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000626272c9 already unused, calling callback (000000000903ef61) 00010000:00010000:0.0:1789518006.573734:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573741:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573749:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.573761:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518006.573805:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0768f58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:3637:x1876445522563968:12345-0@lo:103: Request processed in 187us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518006.573813:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518006.573881:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033023c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522563968:0@lo:103: 00010000:00010000:1.0:1789518006.576564:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000673d4675/0x8d0fd67942313d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313d42 expref: 10 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.576605:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d5896df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1876445522563584:0@lo:104: 00010000:00010000:1.0:1789518006.576642:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.576662:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.576668:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.576673:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000626272c9/0x8d0fd67942313e14 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518006.576694:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789518006.589671:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c7a404a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:7442:x1876445522563200:12345-0@lo:253: Request processed in 51927us (52646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518006.589691:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789518006.589913:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c37e44a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522563200:0@lo:253: 10000000:01000000:0.0:1789518006.589934:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789518006.589938:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518006.589958:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789518006.589960:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518006.589961:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789518006.589962:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518006.589964:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518006.589965:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518006.589966:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789518006.589968:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518006.589969:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789518006.589994:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000278db442 from lustre-MDT0001 10000000:01000000:0.0:1789518006.590052:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789518006.590055:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789518006.590063:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e740dd9cd40 local copy 10000000:01000000:0.0:1789518006.590068:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789518006.590113:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.590125:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.590134:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.590153:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c37e44a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564096:0@lo:101: 00000100:00100000:0.0:1789518006.594567:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.594675:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f648cca3 going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.594814:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564096 00000100:00100000:3.0:1789518006.594827:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564096 00000100:00100000:3.0:1789518006.594914:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518006.594922:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a13f6d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+9:7442:x1876445522564096:12345-0@lo:101: 00010000:00010000:3.0:1789518006.594942:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518006.594967:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001baee067/0x8d0fd67942313e22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313e1b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.595002:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001baee067/0x8d0fd67942313e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313e1b expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.595014:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001baee067/0x8d0fd67942313e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313e1b expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.595023:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001baee067, rc 0) 00000100:00100000:3.0:1789518006.595073:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a13f6d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:7442:x1876445522564096:12345-0@lo:101: Request processed in 152us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.595080:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518006.595267:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c37e44a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564096:0@lo:101: 00010000:00010000:2.0:1789518006.595286:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.595295:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.595446:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564224:0@lo:501: 00000100:00100000:2.0:1789518006.595516:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.595554:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032a2a12b going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.601210:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564224 00000100:00100000:3.0:1789518006.601235:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564224 00000100:00100000:3.0:1789518006.601319:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518006.601330:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3218ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:7442:x1876445522564224:12345-0@lo:501: 00000100:00100000:3.0:1789518006.601595:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3218ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:7442:x1876445522564224:12345-0@lo:501: Request processed in 266us (6078us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518006.601603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518006.604848:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564224:0@lo:501: 10000000:01000000:2.0:1789518006.604888:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789518006.604950:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789518006.604960:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.604972:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.604980:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.605006:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518006.605069:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e74044cd800 10000000:01000000:2.0:1789518006.605076:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789518006.605082:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e740dd9cd40 10000000:01000000:2.0:1789518006.605084:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789518006.605088:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e740dd9cd40 from 1 10000000:01000000:2.0:1789518006.605092:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789518006.605135:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000c7c65d93/0x8d0fd67942313e29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.605144:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000c7c65d93/0x8d0fd67942313e29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.605154:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000c7c65d93/0x8d0fd67942313e29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.605176:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564352:0@lo:101: 00000100:00100000:2.0:1789518006.605249:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.605297:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a5b30 going to sleep for 11 seconds 00000100:00100000:0.0:1789518006.606644:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564352 00000100:00100000:0.0:1789518006.606661:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564352 00000100:00100000:0.0:1789518006.606734:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518006.606742:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000599130a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:7442:x1876445522564352:12345-0@lo:101: 00010000:00010000:0.0:1789518006.606764:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518006.606784:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e9791641/0x8d0fd67942313e30 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313e29 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.606834:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9791641/0x8d0fd67942313e30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313e29 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.606846:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e9791641/0x8d0fd67942313e30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313e29 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.606856:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e9791641, rc 0) 00000100:00100000:0.0:1789518006.606939:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000599130a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:7442:x1876445522564352:12345-0@lo:101: Request processed in 198us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518006.606946:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789518006.607316:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518006.607326:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.607334:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009fd8cb36 already unused, calling callback (00000000505ff6fc) 10000000:00010000:3.0:1789518006.607337:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.607355:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518006.607362:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518006.607368:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518006.607401:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.607408:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518006.607453:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.607460:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 000000009fd8cb36/0x8d0fd67942313e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd67942313e22 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.607498:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518006.607499:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518006.607501:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518006.607568:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c498268 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522564480:0@lo:103: 00000100:00100000:0.0:1789518006.607629:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.607784:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564352:0@lo:101: 00010000:00010000:2.0:1789518006.607801:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000c7c65d93/0x8d0fd67942313e29 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e30 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.607811:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000c7c65d93/0x8d0fd67942313e29 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313e30 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518006.607834:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789518006.607856:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000c7c65d93/0x8d0fd67942313e29 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e30 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.607864:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000c7c65d93/0x8d0fd67942313e29 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e30 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518006.607884:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e74044cd800 10000000:01000000:2.0:1789518006.607889:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789518006.607894:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e74044cd800 from 1 10000000:01000000:2.0:1789518006.607897:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789518006.607917:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000626272c9/0x8d0fd67942313e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.607924:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000626272c9/0x8d0fd67942313e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.607930:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000626272c9/0x8d0fd67942313e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.607943:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564608:0@lo:101: 00000100:00100000:2.0:1789518006.607973:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.607986:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a5b30 going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.608057:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564480 00000100:00100000:3.0:1789518006.608064:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564480 00000100:00100000:3.0:1789518006.608114:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518006.608122:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c990708 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:3639:x1876445522564480:12345-0@lo:103: 00010000:00010000:3.0:1789518006.608133:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518006.608146:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001baee067/0x8d0fd67942313e22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942313e1b expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.608162:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518006.608204:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c990708 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:3639:x1876445522564480:12345-0@lo:103: Request processed in 83us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.608212:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518006.608291:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564608 00000100:00100000:0.0:1789518006.608295:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564608 00000100:00100000:0.0:1789518006.608330:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518006.608336:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d3f6837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+10:7442:x1876445522564608:12345-0@lo:101: 00010000:00010000:0.0:1789518006.608348:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518006.608356:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000323e2936/0x8d0fd67942313e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313e37 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.608371:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000323e2936/0x8d0fd67942313e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313e37 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.608379:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000323e2936/0x8d0fd67942313e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313e37 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.608385:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000323e2936, rc 0) 00000100:00100000:0.0:1789518006.608418:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d3f6837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:7442:x1876445522564608:12345-0@lo:101: Request processed in 82us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518006.608424:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518006.608460:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c498268 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522564480:0@lo:103: 00000100:00100000:2.0:1789518006.608630:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564608:0@lo:101: 00010000:00010000:2.0:1789518006.608641:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000626272c9/0x8d0fd67942313e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.608649:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000626272c9/0x8d0fd67942313e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518006.608660:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789518006.608674:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000626272c9/0x8d0fd67942313e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.608681:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000626272c9/0x8d0fd67942313e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518006.608695:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789518006.608700:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518006.608706:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e74044cd800 10000000:01000000:2.0:1789518006.608709:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789518006.608712:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789518006.608715:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789518006.608731:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000673d4675/0x8d0fd67942313e45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.608737:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000673d4675/0x8d0fd67942313e45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.608743:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000673d4675/0x8d0fd67942313e45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.608757:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564736:0@lo:101: 00000100:00100000:2.0:1789518006.608784:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.608808:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a5b30 going to sleep for 11 seconds 00000100:00100000:2.0:1789518006.608824:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564736 00000100:00100000:2.0:1789518006.608828:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564736 00000100:00100000:2.0:1789518006.608854:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518006.608860:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad8eed49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+11:7442:x1876445522564736:12345-0@lo:101: 00010000:00010000:2.0:1789518006.608867:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518006.608875:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003527dec4/0x8d0fd67942313e4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313e45 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.608909:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003527dec4/0x8d0fd67942313e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.608930:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003527dec4/0x8d0fd67942313e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.608936:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003527dec4, rc 0) 00000100:00100000:2.0:1789518006.608964:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad8eed49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522564736:12345-0@lo:101: Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.608971:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518006.609002:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564736:0@lo:101: 00010000:00010000:2.0:1789518006.609012:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000673d4675/0x8d0fd67942313e45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.609019:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000673d4675/0x8d0fd67942313e45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.609125:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564864:0@lo:501: 00000100:00100000:2.0:1789518006.609150:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.609163:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a5b30 going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.609233:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564864 00000100:00100000:3.0:1789518006.609237:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564864 00000100:00100000:3.0:1789518006.609265:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518006.609272:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098440565 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522564864:12345-0@lo:501: 00000100:00100000:3.0:1789518006.609390:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098440565 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522564864:12345-0@lo:501: Request processed in 119us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.609397:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518006.609502:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564864:0@lo:501: 00000100:00100000:2.0:1789518006.609530:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564992:0@lo:503: 00000100:00100000:2.0:1789518006.609584:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.609601:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a5b30 going to sleep for 11 seconds 00000100:00100000:0.0:1789518006.609668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522564992 00000100:00100000:0.0:1789518006.609673:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522564992 00000100:00100000:0.0:1789518006.609705:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518006.609712:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000068a6338a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522564992:12345-0@lo:503: 00000100:00100000:0.0:1789518006.609801:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000068a6338a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522564992:12345-0@lo:503: Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518006.609809:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518006.610328:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522564992:0@lo:503: 00000040:00080000:2.0:1789518006.610699:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518006.610799:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565120:0@lo:502: 00000100:00100000:2.0:1789518006.610861:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.610900:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a5b30 going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.611016:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522565120 00000100:00100000:3.0:1789518006.611022:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522565120 00000100:00100000:3.0:1789518006.611066:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518006.611073:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ba331ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522565120:12345-0@lo:502: 00000100:00100000:3.0:1789518006.611197:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ba331ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522565120:12345-0@lo:502: Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.611205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518006.613968:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565120:0@lo:502: 00000040:00080000:2.0:1789518006.614330:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789518006.614371:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789518006.614387:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789518006.614401:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789518006.614414:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789518006.614427:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789518006.614438:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789518006.614449:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789518006.614459:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789518006.614512:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789518006.614523:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789518006.614534:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789518006.614544:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789518006.614555:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789518006.614566:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789518006.614592:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789518006.614606:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789518006.614619:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789518006.614631:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789518006.614644:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789518006.614658:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789518006.614671:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789518006.614686:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789518006.614737:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565248:0@lo:502: 00000100:00100000:2.0:1789518006.614837:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.614887:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000724a5b30 going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.618903:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522565248 00000100:00100000:3.0:1789518006.618925:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522565248 00000100:00100000:3.0:1789518006.619014:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518006.619023:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083b44236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522565248:12345-0@lo:502: 00000100:00100000:3.0:1789518006.619266:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083b44236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522565248:12345-0@lo:502: Request processed in 244us (4430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.619275:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518006.620021:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565248:0@lo:502: 00000040:00080000:2.0:1789518006.620148:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789518006.620175:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789518006.620913:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518006.620927:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.620930:0:7455:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789518006.620936:0:7455:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789518006.620939:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518006.620960:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000063666ea5) 00000020:00000080:2.0:1789518006.620990:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789518006.620996:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789518006.621126:0:7455:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789518006.621135:0:7455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942313e5a 00000020:00000080:2.0:1789518006.621399:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789518006.621403:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518006.621407:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.621409:0:7455:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789518006.621412:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518006.621415:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.621417:0:7455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789518006.621421:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518006.621440:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009219af5f) 00000020:00000080:2.0:1789518006.621451:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789518006.621456:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789518006.621458:0:7455:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789518006.621613:0:7455:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789518006.621625:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789518006.621698:0:7455:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000278db442 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789518006.621714:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000004b355a38) 00000020:00000080:2.0:1789518006.621722:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789518006.621800:0:7455:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789518006.621806:0:7455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd67942313e6f 00000020:00000080:2.0:1789518006.621912:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789518006.621919:0:7455:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789518006.621924:0:7455:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8d0fd67942313e76 00080000:01000000:2.0:1789518006.621936:0:7455:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789518006.621940:0:7455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942313e7d 00080000:10000000:2.0:1789518006.623200:0:7455:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789518006.623354:0:7455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00000100:00100000:1.0:1789518006.773860:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003902b4ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522565376:0@lo:400: 00000100:00100000:1.0:1789518006.773950:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518006.774079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522565376 00000100:00100000:3.0:1789518006.774089:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522565376 00000100:00100000:3.0:1789518006.774148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518006.774156:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c439b22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522565376:12345-0@lo:400: 00000100:00100000:3.0:1789518006.774227:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c439b22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522565376:12345-0@lo:400: Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.774234:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789518006.774531:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003902b4ad x1876445522565376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518006.774546:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003902b4ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522565376:0@lo:400: 00010000:00010000:2.0:1789518006.810804:0:7455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789518006.812686:0:7455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789518006.823687:0:7455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789518006.824191:0:7455:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789518006.861916:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789518006.861934:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518006.861942:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518006.861945:0:7455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789518006.861949:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518006.861957:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518006.861958:0:7455:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789518006.861962:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789518006.861969:0:7455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:00000080:0.0:1789518006.862009:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518006.862038:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000001a098ae6) 00000020:00000080:0.0:1789518006.862068:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789518006.862074:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789518006.862169:0:7455:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789518006.862177:0:7455:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789518006.862185:0:7455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942313e8b 00010000:00080000:0.0:1789518006.862223:0:7455:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008c682a67@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789518006.870987:0:7455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1789518006.877841:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789518006.877862:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789518006.877932:0:7455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789518006.877962:0:7455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd67942313e92 00000100:00080000:2.0:1789518006.877974:0:7455:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518006.877987:0:7455:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000008c682a67 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518006.878561:0:7455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b7b3b584 x1876445522565504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518006.878596:0:7455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789518006.878759:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518006.878763:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.878765:0:7455:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789518006.878768:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789518006.878771:0:7455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789518006.878773:0:7455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789518006.878774:0:7455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789518006.878776:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789518006.878778:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.878779:0:7455:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789518006.878781:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518006.878786:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.878787:0:7455:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789518006.878790:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789518006.878840:0:7455:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789518006.878852:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518006.878854:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.878855:0:7455:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789518006.878858:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518006.878860:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.878861:0:7455:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789518006.878864:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789518006.878865:0:7455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789518006.878894:0:7455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518006.878896:0:7455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518006.878898:0:7455:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789518006.878900:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1789518006.878971:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:0.0:1789518006.879133:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522565504:0@lo:38: 00000100:00100000:0.0:1789518006.879247:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.879377:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522565504 00000100:00100000:0.0:1789518006.879387:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522565504 00000100:00100000:0.0:1789518006.879425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518006.879432:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002be2476c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1876445522565504:12345-0@lo:38: 00010000:00080000:0.0:1789518006.879461:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:0.0:1789518006.879534:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd67942313e99 00000004:00100000:0.0:1789518006.879550:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789518006.879556:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:2.0:1789518006.887869:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789518006.887916:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000673d4675/0x8d0fd67942313e45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.887933:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000673d4675/0x8d0fd67942313e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518006.888187:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e74044cd800 from 1 10000000:01000000:0.0:1789518006.888192:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518006.888249:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.888259:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.888271:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.888302:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565632:0@lo:101: 00000100:00100000:0.0:1789518006.888399:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.888445:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b23cfd1e going to sleep for 11 seconds 00000100:00100000:2.0:1789518006.892122:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522565632 00000100:00100000:2.0:1789518006.892144:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522565632 00000100:00100000:2.0:1789518006.892218:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518006.892229:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005692f890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+12:7442:x1876445522565632:12345-0@lo:101: 00010000:00010000:2.0:1789518006.892250:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518006.892274:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313ea0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.892308:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.892338:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518006.892348:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bddbb3c8, rc 0) 00000100:00100000:2.0:1789518006.892452:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005692f890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+13:7442:x1876445522565632:12345-0@lo:101: Request processed in 225us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.892459:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518006.893333:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565632:0@lo:101: 00010000:00010000:0.0:1789518006.893362:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.893386:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.893987:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565760:0@lo:256: 00000100:00100000:0.0:1789518006.894080:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.894133:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b23cfd1e going to sleep for 11 seconds 00000100:00100000:2.0:1789518006.900664:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522565760 00000100:00100000:2.0:1789518006.900689:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522565760 00000100:00100000:2.0:1789518006.900761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518006.900771:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007e3798f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+13:7442:x1876445522565760:12345-0@lo:256: 20000000:01000000:2.0:1789518006.900806:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789518006.901512:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789518006.901519:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789518006.901773:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007e3798f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+13:7442:x1876445522565760:12345-0@lo:256: Request processed in 929us (7619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.901785:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518006.902530:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565760:0@lo:256: 10000000:01000000:0.0:1789518006.903140:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518006.903168:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.903183:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518006.903192:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e74044cd800 from 1 10000000:01000000:0.0:1789518006.903196:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518006.903245:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.903253:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.903263:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.903284:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565888:0@lo:101: 00000100:00100000:0.0:1789518006.903356:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518006.903398:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522565888 00000100:00100000:0.0:1789518006.903403:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b23cfd1e going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.903407:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522565888 00000100:00100000:3.0:1789518006.903461:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518006.903490:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000519de918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+13:7442:x1876445522565888:12345-0@lo:101: 00010000:00010000:3.0:1789518006.903504:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518006.903518:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.903543:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313eae expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.903553:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313eae expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.903561:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001baee067, rc 0) 00000100:00100000:3.0:1789518006.903614:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000519de918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:7442:x1876445522565888:12345-0@lo:101: Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.903620:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518006.905322:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522565888:0@lo:101: 00010000:00010000:0.0:1789518006.905355:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.905369:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.905557:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566016:0@lo:501: 00000100:00100000:0.0:1789518006.905638:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.905696:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b23cfd1e going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.905847:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566016 00000100:00100000:3.0:1789518006.905856:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566016 00000100:00100000:3.0:1789518006.905913:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518006.905923:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071331baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:7442:x1876445522566016:12345-0@lo:501: 00000100:00100000:3.0:1789518006.906081:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071331baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:7442:x1876445522566016:12345-0@lo:501: Request processed in 159us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.906089:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518006.906189:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8ab0e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566016:0@lo:501: 00000100:00100000:3.0:1789518006.906226:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566144:0@lo:503: 00000100:00100000:3.0:1789518006.906269:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518006.906285:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6abd10 going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.906299:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566144 00000100:00100000:3.0:1789518006.906304:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566144 00000100:00100000:3.0:1789518006.906327:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518006.906332:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e18a0839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:7442:x1876445522566144:12345-0@lo:503: 00000040:00080000:3.0:1789518006.906368:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518006.906407:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e18a0839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:7442:x1876445522566144:12345-0@lo:503: Request processed in 74us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.906414:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518006.906459:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566144:0@lo:503: 00000040:00080000:3.0:1789518006.907437:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518006.907531:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789518006.907667:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789518006.910401:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000af53d502 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518006.910563:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002be2476c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1876445522565504:12345-0@lo:38: Request processed in 31127us (31323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.910596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518006.910991:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518006.911015:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789518006.911026:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789518006.911049:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518006.911052:0:3636:0:(import.c:65:import_set_state_nolock()) 000000008c682a67 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518006.911065:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b3b584 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522565504:0@lo:38: 00000040:00080000:3.0:1789518006.912273:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789518006.912718:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789518006.912776:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518006.912791:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.912805:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518006.912877:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518006.912880:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e74044cd800 10000000:01000000:1.0:1789518006.912884:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e74044cd800 10000000:01000000:1.0:1789518006.912888:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518006.912894:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e74044cd800 from 1 10000000:01000000:1.0:1789518006.912897:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518006.912943:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000003331c985/0x8d0fd67942313ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.912951:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000003331c985/0x8d0fd67942313ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.912962:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000003331c985/0x8d0fd67942313ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.912987:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079e9f5a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566272:0@lo:101: 00000100:00100000:1.0:1789518006.913083:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.913123:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566272 00000100:00100000:1.0:1789518006.913125:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005508a05 going to sleep for 11 seconds 00000100:00100000:0.0:1789518006.913132:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566272 00000100:00100000:0.0:1789518006.913175:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518006.913184:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bf3bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:7442:x1876445522566272:12345-0@lo:101: 00010000:00010000:0.0:1789518006.913198:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518006.913210:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091161a55/0x8d0fd67942313ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518006.913225:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c311a7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522566400:0@lo:41: 00010000:00010000:0.0:1789518006.913236:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091161a55/0x8d0fd67942313ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.913248:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091161a55/0x8d0fd67942313ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.913256:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091161a55, rc 0) 00000100:00100000:2.0:1789518006.913263:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518006.913415:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566400 00000100:00100000:1.0:1789518006.913420:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566400 00000100:00100000:1.0:1789518006.913456:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518006.913488:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007fb1db16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876445522566400:12345-0@lo:41: 00000004:00000024:1.0:1789518006.913518:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789518006.916183:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bf3bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566272:12345-0@lo:101: Request processed in 2989us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518006.916199:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518006.916346:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079e9f5a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566272:0@lo:101: 00010000:00010000:0.0:1789518006.916378:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000003331c985/0x8d0fd67942313ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.916393:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000003331c985/0x8d0fd67942313ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.916486:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007fb1db16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876445522566400:12345-0@lo:41: Request processed in 3000us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518006.916496:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518006.916560:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000531a2207 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566528:0@lo:501: 00000100:00100000:0.0:1789518006.916615:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.916660:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000253e7c5f going to sleep for 11 seconds 00000100:00100000:2.0:1789518006.916674:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566528 00000100:00100000:2.0:1789518006.916681:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566528 00000100:00100000:2.0:1789518006.916731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789518006.916739:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9999ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566528:12345-0@lo:501: 00000100:00100000:2.0:1789518006.916894:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9999ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566528:12345-0@lo:501: Request processed in 156us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.916901:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518006.917064:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000531a2207 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566528:0@lo:501: 00000100:00100000:1.0:1789518006.917099:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566656:0@lo:503: 00000100:00100000:1.0:1789518006.917141:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518006.917166:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e9e44a0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518006.917492:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566656 00000100:00100000:2.0:1789518006.917497:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566656 00000100:00100000:2.0:1789518006.917528:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518006.917534:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc472eae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566656:12345-0@lo:503: 00000100:00100000:2.0:1789518006.917656:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc472eae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566656:12345-0@lo:503: Request processed in 109us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518006.917663:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518006.918060:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566656:0@lo:503: 00000040:00080000:1.0:1789518006.918526:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518006.918635:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566784:0@lo:502: 00000100:00100000:1.0:1789518006.918978:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518006.919361:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e9e44a0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518006.919406:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566784 00000100:00100000:1.0:1789518006.919414:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566784 00000100:00100000:1.0:1789518006.919458:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518006.919499:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000162c9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566784:12345-0@lo:502: 00000100:00100000:1.0:1789518006.919834:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000162c9e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566784:12345-0@lo:502: Request processed in 336us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518006.919842:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518006.919910:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566784:0@lo:502: 00000040:00080000:1.0:1789518006.920594:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789518006.920642:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789518006.920820:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789518006.920834:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789518006.920848:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789518006.920862:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789518006.920876:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789518006.920892:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789518006.920907:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789518006.920922:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789518006.920939:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789518006.920955:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789518006.920972:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789518006.920989:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000100:00100000:3.0:1789518006.921174:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c311a7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522566400:0@lo:41: 00000040:00080000:1.0:1789518006.921403:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789518006.921448:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789518006.921484:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789518006.921502:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789518006.921514:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789518006.921526:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789518006.921538:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789518006.921550:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789518006.921563:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789518006.921591:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789518006.921605:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789518006.921618:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789518006.921631:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789518006.921642:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789518006.921876:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566912:0@lo:502: 00000100:00100000:1.0:1789518006.921966:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518006.922031:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f0738da going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.922103:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522566912 00000100:00100000:3.0:1789518006.922113:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522566912 00000100:00100000:3.0:1789518006.922172:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789518006.922181:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067388e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566912:12345-0@lo:502: 00000100:00100000:3.0:1789518006.922412:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067388e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522566912:12345-0@lo:502: Request processed in 231us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.922422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518006.922614:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522566912:0@lo:502: 00000040:00080000:1.0:1789518006.922694:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789518006.922710:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789518006.924227:0:7461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789518006.924262:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000390d53db) 00000020:00000080:1.0:1789518006.924416:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789518006.924604:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000278db442 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789518006.924608:0:7461:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000278db442 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789518006.924611:0:7461:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000278db442 3 00010000:00080000:1.0:1789518006.924707:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003bc67339@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789518006.928217:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789518006.929360:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789518006.929418:0:7461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789518006.929436:0:7461:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8d0fd67942313ed1 00000100:00080000:1.0:1789518006.929450:0:7461:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518006.929552:0:7461:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003bc67339 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518006.929612:0:7461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009218b25c x1876445522567040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518006.929686:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522567040:0@lo:38: 00000100:00100000:2.0:1789518006.929775:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518006.929833:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1789518006.930176:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1789518006.930516:0:7462:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1789518006.932172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567040 00000100:00100000:3.0:1789518006.932190:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567040 00000100:00100000:3.0:1789518006.934132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518006.934145:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026c7bc6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1876445522567040:12345-0@lo:38: 00010000:00080000:3.0:1789518006.934184:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1789518006.934259:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8d0fd67942313ed8 00000004:00100000:3.0:1789518006.934280:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518006.934335:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000671ba83b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518006.934454:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026c7bc6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876445522567040:12345-0@lo:38: Request processed in 308us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.934482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789518006.934735:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009218b25c x1876445522567040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518006.934749:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518006.934759:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789518006.934768:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789518006.934774:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518006.934777:0:3636:0:(import.c:65:import_set_state_nolock()) 000000003bc67339 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518006.934783:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522567040:0@lo:38: 00000020:01000000:3.0:1789518006.937370:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789518006.937443:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789518006.938460:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000003331c985/0x8d0fd67942313ebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518006.938500:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000003331c985/0x8d0fd67942313ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789518006.938737:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789518006.938740:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789518006.938742:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518006.938742:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518006.938744:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518006.938745:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518006.938746:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789518006.938747:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518006.938749:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518006.938750:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518006.938751:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518006.938757:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789518006.938760:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518006.938761:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789518006.938762:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518006.938763:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518006.938764:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518006.938765:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518006.938766:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789518006.938767:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518006.938774:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518006.938775:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518006.938776:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518006.938813:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789518006.938841:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8556561 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522567168:0@lo:253: 00000100:00100000:2.0:1789518006.938949:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518006.939058:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f08d3a03 going to sleep for 11 seconds 00000100:00100000:0.0:1789518006.939117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567168 00000100:00100000:0.0:1789518006.939128:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567168 00000100:00100000:0.0:1789518006.939256:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518006.939266:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a139db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522567168:12345-0@lo:253: 20000000:01000000:0.0:1789518006.939417:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789518006.939435:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789518006.943789:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789518006.943920:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789518006.943939:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789518006.947727:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a139db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7442:x1876445522567168:12345-0@lo:253: Request processed in 8448us (8764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518006.947748:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518006.947917:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8556561 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7442:1876445522567168:0@lo:253: 10000000:01000000:3.0:1789518006.947938:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789518006.947941:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518006.947944:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789518006.947945:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518006.947947:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518006.947948:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518006.947949:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518006.947950:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789518006.947952:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789518006.947953:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789518006.947954:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518006.947956:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789518006.947999:0:7442:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789518006.950523:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518006.950562:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518006.950606:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.950629:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.950636:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.950643:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.950694:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.950712:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 14 pid: 6505 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.950727:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522567296:0@lo:104: 00000100:00100000:1.0:1789518006.950817:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518006.950892:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.950899:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 14 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.950908:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033108dc5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522567424:0@lo:104: 00000100:00100000:1.0:1789518006.950953:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518006.950978:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f0738da going to sleep for 11 seconds 00000100:00100000:1.0:1789518006.951012:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567296 00000100:00100000:1.0:1789518006.951026:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567296 00000100:00100000:1.0:1789518006.951072:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567424 00000100:00100000:1.0:1789518006.951075:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567424 00000100:00100000:1.0:1789518006.951090:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518006.951098:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c592654e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6529:x1876445522567296:12345-0@lo:104: 00010000:00010000:1.0:1789518006.951112:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.951176:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518006.951181:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c592654e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6529:x1876445522567296:12345-0@lo:104: Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518006.951189:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518006.951207:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518006.951212:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f035b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522567424:12345-0@lo:104: 00010000:00010000:1.0:1789518006.951218:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.951250:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789518006.951253:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f035b14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522567424:12345-0@lo:104: Request processed in 43us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518006.951259:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789518006.951275:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518006.951281:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952401:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000188aefc3 already unused, calling callback (00000000505ff6fc) 10000000:00010000:1.0:1789518006.952417:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952457:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518006.952480:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518006.952486:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518006.952540:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952547:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518006.952591:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952598:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 00000000188aefc3/0x8d0fd67942313ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952617:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518006.952621:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952627:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6e1e297 already unused, calling callback (00000000505ff6fc) 10000000:00010000:1.0:1789518006.952629:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952635:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518006.952640:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518006.952651:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518006.952664:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952670:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518006.952686:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952693:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 00000000d6e1e297/0x8d0fd67942313df8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.952709:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518006.952711:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518006.952713:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518006.952737:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb8b1d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522567552:0@lo:103: 00000100:00100000:1.0:1789518006.952799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518006.952866:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000690d1d19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522567680:0@lo:103: 00000100:00100000:1.0:1789518006.952897:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518006.952934:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567552 00000100:00100000:1.0:1789518006.952942:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567552 00010000:00010000:1.0:1789518006.952967:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 15 pid: 6505 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.952995:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567680 00000100:00100000:1.0:1789518006.952997:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567680 00010000:00010000:1.0:1789518006.953007:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 16 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518006.953019:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518006.953032:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000401663f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3638:x1876445522567552:12345-0@lo:103: 00010000:00010000:1.0:1789518006.953047:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518006.953052:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 16 pid: 6505 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953063:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 16 pid: 6505 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953080:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518006.953112:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000401663f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3638:x1876445522567552:12345-0@lo:103: Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518006.953119:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518006.953137:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518006.953143:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045fecb04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3639:x1876445522567680:12345-0@lo:103: 00010000:00010000:1.0:1789518006.953150:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518006.953154:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 15 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953162:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 15 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953174:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953184:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518006.953201:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002640720s 00010000:00010000:1.0:1789518006.953206:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953223:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953229:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953235:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953240:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a88cbc9 already unused, calling callback (000000000903ef61) 00010000:00010000:1.0:1789518006.953244:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953250:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953258:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518006.953269:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518006.956278:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518006.960443:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bddbb3c8/0x8d0fd67942313ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313ea0 expref: 15 pid: 6505 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.960492:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009218b25c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522567296:0@lo:104: 00010000:00010000:0.0:1789518006.960511:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d140116c/0x8d0fd67942313dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313df8 expref: 14 pid: 6506 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518006.960520:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033108dc5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522567424:0@lo:104: 00010000:00010000:0.0:1789518006.960593:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.960605:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.960612:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518006.960617:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313edf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518006.965922:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb8b1d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522567552:0@lo:103: 00000100:00100000:1.0:1789518006.966148:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045fecb04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+13:3639:x1876445522567680:12345-0@lo:103: Request processed in 13004us (13249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518006.966163:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518006.970163:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000690d1d19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522567680:0@lo:103: 00080000:10000000:2.0:1789518006.971209:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1789518006.971673:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789518006.971881:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789518006.972430:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789518006.974227:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789518006.975649:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789518006.991715:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789518006.994354:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789518006.994804:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789518006.994986:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789518006.995204:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1789518006.995396:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789518006.998056:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1789518006.998590:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1789518006.998654:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876445522567808:0@lo:700: 00000100:00100000:0.0:1789518006.998737:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518006.998804:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049f47226 going to sleep for 11 seconds 00000040:01000000:3.0:1789518006.998854:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789518006.999153:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522567936:0@lo:1000: 00000100:00100000:3.0:1789518006.999194:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518006.999233:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567936 00000100:00100000:3.0:1789518006.999252:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567936 00000100:00100000:3.0:1789518006.999312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518006.999322:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000754c1162 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522567936:12345-0@lo:1000: 00000100:00100000:3.0:1789518006.999410:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000754c1162 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522567936:12345-0@lo:1000: Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518006.999417:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518006.999449:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8f549b1 going to sleep for 11 seconds 00000100:00100000:3.0:1789518006.999505:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522567936:0@lo:1000: 00000040:01000000:3.0:1789518006.999535:0:7468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1789518006.999555:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568064:0@lo:700: 00000100:00100000:3.0:1789518006.999591:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518006.999604:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000040:01000000:0.0:1789518007.000198:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789518007.000429:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789518007.000974:0:7442:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789518007.000983:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789518007.001134:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518007.001509:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522567808 00000100:00100000:1.0:1789518007.001522:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522567808 00000100:00100000:1.0:1789518007.001595:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518007.001605:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024d2f64e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7467:x1876445522567808:12345-0@lo:700: 00000100:00100000:1.0:1789518007.001735:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522568064 00000100:00100000:1.0:1789518007.001740:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522568064 00000100:00100000:1.0:1789518007.001775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518007.001780:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6cd77de pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568064:12345-0@lo:700: 00000100:00100000:1.0:1789518007.001928:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6cd77de pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568064:12345-0@lo:700: Request processed in 148us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518007.001935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518007.006692:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568064:0@lo:700: 00000100:00100000:3.0:1789518007.006804:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7468:1876445522568192:0@lo:900: 00000100:00100000:3.0:1789518007.006925:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518007.006959:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000040:00080000:0.0:1789518007.008222:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789518007.008413:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522568192 00000100:00100000:1.0:1789518007.008424:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522568192 00000100:00100000:1.0:1789518007.008518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518007.008527:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000363eaddd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7468:x1876445522568192:12345-0@lo:900: 00000100:00100000:1.0:1789518007.008645:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000363eaddd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7468:x1876445522568192:12345-0@lo:900: Request processed in 119us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518007.008652:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789518007.009106:0:7468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047c3f7d0 x1876445522568192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789518023 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518007.009123:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7468:1876445522568192:0@lo:900: 00000100:00100000:3.0:1789518007.009249:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568320:0@lo:1000: 00000100:00100000:3.0:1789518007.009301:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518007.009334:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522568320 00000100:00100000:3.0:1789518007.009338:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522568320 00000100:00100000:3.0:1789518007.009368:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518007.009374:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099de9c45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568320:12345-0@lo:1000: 00000100:00100000:3.0:1789518007.009488:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099de9c45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568320:12345-0@lo:1000: Request processed in 115us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518007.009495:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518007.009517:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 000000004124e793 going to sleep for 11 seconds 00000100:00100000:3.0:1789518007.009527:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568320:0@lo:1000: 00000004:00080000:3.0:1789518007.009590:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d18192ff with version 0 00000020:00100000:3.0:1789518007.009603:0:7468:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789518007.009608:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000047c3f7d0 x1876445522568576/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518007.009619:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568576:0@lo:1000: 00000100:00100000:3.0:1789518007.009639:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518007.009654:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522568576 00000100:00100000:3.0:1789518007.009657:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522568576 00000100:00100000:3.0:1789518007.009670:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518007.009674:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eaa59a7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568576:12345-0@lo:1000: 00000100:00100000:3.0:1789518007.010058:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000182499bf going to sleep for 11 seconds 00000020:00080000:2.0:1789518007.013844:0:7466:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789518007.013858:0:7466:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 40000000:02000000:3.0:1789518007.014564:0:6520:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:0.0:1789518007.016252:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789518007.016486:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789518007.016840:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789518007.019085:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789518007.025045:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789518007.029053:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789518007.030001:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789518007.030158:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:3.0:1789518007.034897:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024d2f64e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7467:x1876445522567808:12345-0@lo:700: Request processed in 33282us (36148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518007.034928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1789518007.036176:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789518007.036529:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789518007.036712:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789518007.036854:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789518007.037028:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789518007.037166:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789518007.037304:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789518007.037435:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00010000:00080000:0.0:1789518007.037813:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000badd3cb9 x1876445522567808/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789518022 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518007.037853:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876445522567808:0@lo:700: 40000000:02000000:0.0:1789518007.037872:0:7467:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1789518007.046767:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789518007.047006:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789518007.047136:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789518007.047321:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789518007.047770:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789518007.047915:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789518007.048058:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789518007.048221:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789518007.048351:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789518007.048516:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789518007.048664:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789518007.048823:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789518007.048955:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789518007.049082:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789518007.049223:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789518007.049372:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789518007.049539:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789518007.065758:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000001:00080000:0.0:1789518007.067091:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1789518007.067720:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eaa59a7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568576:12345-0@lo:1000: Request processed in 58037us (58072us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789518007.067737:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1789518007.074431:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789518007.074446:0:7468:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789518007.074525:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568576:0@lo:1000: 00000100:00100000:0.0:1789518007.074687:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568704:0@lo:1000: 00000100:00100000:0.0:1789518007.074770:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518007.074903:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a6caabe going to sleep for 11 seconds 00000100:00100000:1.0:1789518007.075432:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522568704 00000100:00100000:1.0:1789518007.075443:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522568704 00000100:00100000:1.0:1789518007.075548:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518007.075558:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000924647ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568704:12345-0@lo:1000: 00000100:00100000:1.0:1789518007.075685:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000924647ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1876445522568704:12345-0@lo:1000: Request processed in 127us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518007.075693:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:1.0:1789518007.076076:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789518007.076287:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789518007.076546:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789518007.078123:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1876445522568704:0@lo:1000: 00000040:00080000:0.0:1789518007.078173:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789518007.078218:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000049f47226 with version 1 00000004:00080000:2.0:1789518007.078887:0:7458:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000450b8440 version 1 rpc_version 1 00000020:00100000:2.0:1789518007.078929:0:7458:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789518007.078939:0:7458:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f7412ee3 x1876445522568960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518007.078965:0:7458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7412ee3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7458:1876445522568960:0@lo:1000: 00000100:00100000:2.0:1789518007.079058:0:7458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518007.079110:0:7458:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b333fc20 going to sleep for 11 seconds 00000040:00080000:0.0:1789518007.080955:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789518007.081072:0:7468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 1, retries 0 00000100:00100000:1.0:1789518007.081787:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522568960 00000100:00100000:1.0:1789518007.081819:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522568960 00000100:00100000:1.0:1789518007.081895:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518007.081904:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b9dd442 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7458:x1876445522568960:12345-0@lo:1000: 00000001:00080000:0.0:1789518007.094165:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789518007.094408:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b9dd442 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7458:x1876445522568960:12345-0@lo:1000: Request processed in 12500us (15345us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789518007.094425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789518007.094701:0:7458:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789518007.094707:0:7458:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789518007.094729:0:7458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7412ee3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7458:1876445522568960:0@lo:1000: 00000001:00080000:1.0:1789518007.095526:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789518007.095581:0:7442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb99641c67988 00100000:10000000:1.0:1789518007.095592:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1789518007.095713:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:2.0:1789518007.098652:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789518007.098702:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789518007.098730:0:7442:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789518007.098778:0:7442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789518007.100768:0:7442:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518007.100982:0:7442:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1789518007.134060:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789518007.134178:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1789518007.134184:0:7467:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1789518007.351618:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518008.374772:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518009.397813:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518010.423869:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518011.445961:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518011.919643:0:7713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789518012.406649:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522569088:0@lo:41: 00000100:00100000:1.0:1789518012.406739:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789518012.406938:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518012.406943:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e74044cd800 from 4 10000000:01000000:3.0:1789518012.406947:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518012.406982:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000c47773b3/0x8d0fd67942313ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518012.406994:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000c47773b3/0x8d0fd67942313ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518012.407005:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000c47773b3/0x8d0fd67942313ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518012.407022:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569216:0@lo:101: 00000100:00100000:3.0:1789518012.407060:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518012.407096:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000100:00100000:0.0:1789518012.407165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569088 00000100:00100000:0.0:1789518012.407176:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569088 00000100:00100000:0.0:1789518012.407256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518012.407266:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067d85fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522569088:12345-0@lo:41: 00000004:00000024:0.0:1789518012.407314:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789518012.407376:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067d85fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522569088:12345-0@lo:41: Request processed in 111us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518012.407398:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518012.407443:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522569088:0@lo:41: 00000100:00100000:1.0:1789518012.408691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569216 00000100:00100000:1.0:1789518012.408712:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569216 00000100:00100000:1.0:1789518012.408763:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518012.408770:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f76d4b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+13:6509:x1876445522569216:12345-0@lo:101: 00010000:00010000:1.0:1789518012.408784:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518012.408802:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313eed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.408827:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.408838:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bafc8c9/0x8d0fd67942313eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.408847:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bafc8c9, rc 0) 00000100:00100000:1.0:1789518012.408903:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f76d4b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:6509:x1876445522569216:12345-0@lo:101: Request processed in 134us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.408921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789518012.409086:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569216:0@lo:101: 00010000:00010000:3.0:1789518012.409120:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000c47773b3/0x8d0fd67942313ee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518012.409130:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000c47773b3/0x8d0fd67942313ee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518012.409182:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569600:0@lo:256: 00000100:00100000:3.0:1789518012.409238:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518012.409273:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000100:00100000:2.0:1789518012.410562:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097d672f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522569472:0@lo:400: 00000100:00100000:2.0:1789518012.410625:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.410675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518012.410681:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d666cf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522569344:0@lo:400: 00000100:00100000:2.0:1789518012.410714:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.410749:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569472 00000100:00100000:2.0:1789518012.410757:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569472 00000100:00100000:2.0:1789518012.410793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569344 00000100:00100000:2.0:1789518012.410795:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569344 00000100:00100000:2.0:1789518012.410807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518012.410814:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7412ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522569472:12345-0@lo:400: 00000100:00100000:2.0:1789518012.410860:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7412ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522569472:12345-0@lo:400: Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518012.410866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518012.410881:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518012.410885:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004168d2ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522569344:12345-0@lo:400: 00000100:00100000:2.0:1789518012.410906:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004168d2ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522569344:12345-0@lo:400: Request processed in 21us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518012.410911:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789518012.410938:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d666cf2a x1876445522569344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518012.410951:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d666cf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522569344:0@lo:400: 00010000:00080000:2.0:1789518012.410960:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000097d672f6 x1876445522569472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518012.410967:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097d672f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522569472:0@lo:400: 00000100:00100000:1.0:1789518012.411496:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569600 00000100:00100000:1.0:1789518012.411502:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569600 00000100:00100000:1.0:1789518012.411541:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789518012.411547:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f32fab38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:6509:x1876445522569600:12345-0@lo:256: 20000000:01000000:1.0:1789518012.411565:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789518012.411582:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789518012.411585:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789518012.411671:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f32fab38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:6509:x1876445522569600:12345-0@lo:256: Request processed in 124us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.411677:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518012.413641:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569600:0@lo:256: 10000000:01000000:3.0:1789518012.413723:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518012.413733:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000c47773b3/0x8d0fd67942313ee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518012.413744:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000c47773b3/0x8d0fd67942313ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518012.413754:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789518012.413756:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7439644800 from 21 10000000:01000000:3.0:1789518012.413758:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518012.413792:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000bbe4dac8/0x8d0fd67942313ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518012.413799:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000bbe4dac8/0x8d0fd67942313ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518012.413807:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000bbe4dac8/0x8d0fd67942313ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518012.413837:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569728:0@lo:101: 00000100:00100000:3.0:1789518012.413893:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518012.413944:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.414750:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569728 00000100:00100000:1.0:1789518012.414762:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569728 00000100:00100000:1.0:1789518012.414822:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789518012.414830:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb282d51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:6509:x1876445522569728:12345-0@lo:101: 00010000:00010000:1.0:1789518012.414847:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518012.414861:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313ef4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.414887:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.414897:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a88cbc9/0x8d0fd67942313efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.414905:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a88cbc9, rc 0) 00000100:00100000:1.0:1789518012.414966:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb282d51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522569728:12345-0@lo:101: Request processed in 137us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.414985:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518012.415576:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569728:0@lo:101: 00010000:00010000:3.0:1789518012.415593:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000bbe4dac8/0x8d0fd67942313ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518012.415604:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000bbe4dac8/0x8d0fd67942313ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518012.415676:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569856:0@lo:501: 00000100:00100000:3.0:1789518012.415726:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518012.415764:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000100:00100000:2.0:1789518012.415984:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569856 00000100:00100000:2.0:1789518012.415991:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569856 00000100:00100000:2.0:1789518012.416031:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518012.416038:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008eed1828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522569856:12345-0@lo:501: 00000100:00100000:2.0:1789518012.416926:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008eed1828 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522569856:12345-0@lo:501: Request processed in 885us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518012.416936:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518012.417413:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569856:0@lo:501: 00000100:00100000:3.0:1789518012.417502:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569984:0@lo:503: 00000100:00100000:3.0:1789518012.417562:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518012.417644:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000100:00100000:0.0:1789518012.430614:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522569984 00000100:00100000:0.0:1789518012.430633:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522569984 00000100:00100000:0.0:1789518012.433629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518012.433655:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c932bf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522569984:12345-0@lo:503: 00000100:00100000:0.0:1789518012.433859:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c932bf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522569984:12345-0@lo:503: Request processed in 216us (16297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518012.433868:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518012.434017:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057ef1068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522569984:0@lo:503: 00000100:00100000:3.0:1789518012.436875:0:7735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001118f6d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7735:1876445522570112:0@lo:502: 00000100:00100000:3.0:1789518012.436965:0:7735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.444588:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522570112 00000100:00100000:2.0:1789518012.444605:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522570112 00000100:00100000:2.0:1789518012.444717:0:7735:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18192ff going to sleep for 11 seconds 00000100:00100000:2.0:1789518012.444788:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518012.444797:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a16e28e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7735:x1876445522570112:12345-0@lo:502: 00000100:00100000:2.0:1789518012.444989:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a16e28e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7735:x1876445522570112:12345-0@lo:502: Request processed in 193us (8023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518012.444998:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518012.445062:0:7735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001118f6d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7735:1876445522570112:0@lo:502: 00000100:00100000:2.0:1789518012.445400:0:7735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7735:1876445522570240:0@lo:502: 00000100:00100000:2.0:1789518012.445447:0:7735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.445494:0:7735:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076da8e12 going to sleep for 11 seconds 00000100:00100000:2.0:1789518012.445508:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522570240 00000100:00100000:2.0:1789518012.445514:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522570240 00000100:00100000:2.0:1789518012.445548:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789518012.445554:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f22323a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7735:x1876445522570240:12345-0@lo:502: 00000100:00100000:2.0:1789518012.445624:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f22323a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:7735:x1876445522570240:12345-0@lo:502: Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518012.445632:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789518012.445675:0:7735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7735:1876445522570240:0@lo:502: 00000040:00080000:2.0:1789518012.445694:0:7735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789518012.445761:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789518012.445782:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518012.445789:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000bbe4dac8/0x8d0fd67942313ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.445802:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000bbe4dac8/0x8d0fd67942313ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518012.445812:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789518012.445814:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7439644800 from 4 10000000:01000000:2.0:1789518012.445817:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789518012.445842:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000bddbb3c8/0x8d0fd67942313f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.445850:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000bddbb3c8/0x8d0fd67942313f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.445858:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000bddbb3c8/0x8d0fd67942313f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518012.445869:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570368:0@lo:101: 00000100:00100000:2.0:1789518012.445897:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.445910:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076da8e12 going to sleep for 11 seconds 00000100:00100000:2.0:1789518012.445926:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522570368 00000100:00100000:2.0:1789518012.445930:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522570368 00000100:00100000:2.0:1789518012.445946:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518012.445952:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000783ac4e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522570368:12345-0@lo:101: 00010000:00010000:2.0:1789518012.445960:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518012.445980:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6e1e297/0x8d0fd67942313f09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.446001:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6e1e297/0x8d0fd67942313f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.446011:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6e1e297/0x8d0fd67942313f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.446019:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6e1e297, rc 0) 00000100:00100000:2.0:1789518012.446047:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000783ac4e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522570368:12345-0@lo:101: Request processed in 96us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518012.446053:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518012.446075:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570368:0@lo:101: 00010000:00010000:2.0:1789518012.446085:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000bddbb3c8/0x8d0fd67942313f02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.446094:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000bddbb3c8/0x8d0fd67942313f02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518012.447029:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570496:0@lo:256: 00000100:00100000:2.0:1789518012.447080:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.447421:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076da8e12 going to sleep for 11 seconds 00000100:00100000:2.0:1789518012.447452:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522570496 00000100:00100000:2.0:1789518012.447459:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522570496 00000100:00100000:3.0:1789518012.451858:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789518012.451882:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004f13c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522570496:12345-0@lo:256: 20000000:01000000:3.0:1789518012.451915:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789518012.451936:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789518012.451940:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789518012.452093:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004f13c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522570496:12345-0@lo:256: Request processed in 221us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518012.452103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518012.453546:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570496:0@lo:256: 10000000:01000000:2.0:1789518012.453614:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789518012.453624:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000bddbb3c8/0x8d0fd67942313f02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.453648:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000bddbb3c8/0x8d0fd67942313f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518012.453659:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789518012.453661:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789518012.453664:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789518012.453699:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000309e8789/0x8d0fd67942313f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.453707:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000309e8789/0x8d0fd67942313f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.453716:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000309e8789/0x8d0fd67942313f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518012.453734:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570624:0@lo:101: 00000100:00100000:2.0:1789518012.453789:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.453829:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076da8e12 going to sleep for 11 seconds 00000100:00100000:0.0:1789518012.453902:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522570624 00000100:00100000:0.0:1789518012.453911:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522570624 00000100:00100000:0.0:1789518012.453947:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518012.453956:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b3decb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522570624:12345-0@lo:101: 00010000:00010000:0.0:1789518012.453969:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518012.453982:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000188aefc3/0x8d0fd67942313f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313f10 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.454004:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000188aefc3/0x8d0fd67942313f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.454014:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000188aefc3/0x8d0fd67942313f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.454021:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000188aefc3, rc 0) 00000100:00100000:0.0:1789518012.454065:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b3decb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522570624:12345-0@lo:101: Request processed in 111us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518012.454071:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518012.454445:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570624:0@lo:101: 00010000:00010000:2.0:1789518012.454460:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000309e8789/0x8d0fd67942313f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518012.454493:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000309e8789/0x8d0fd67942313f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518012.454571:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570752:0@lo:501: 00000100:00100000:2.0:1789518012.454599:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.454629:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076da8e12 going to sleep for 11 seconds 00000100:00100000:0.0:1789518012.454702:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522570752 00000100:00100000:0.0:1789518012.454708:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522570752 00000100:00100000:0.0:1789518012.454732:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518012.454737:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa6e5c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522570752:12345-0@lo:501: 00000100:00100000:0.0:1789518012.454867:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa6e5c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522570752:12345-0@lo:501: Request processed in 129us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518012.454874:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789518012.454941:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570752:0@lo:501: 00000100:00100000:2.0:1789518012.454968:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570880:0@lo:503: 00000100:00100000:2.0:1789518012.455010:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.455035:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076da8e12 going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.455102:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522570880 00000100:00100000:1.0:1789518012.455107:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522570880 00000100:00100000:1.0:1789518012.455129:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518012.455134:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f76bcabf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522570880:12345-0@lo:503: 00000100:00100000:1.0:1789518012.455366:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f76bcabf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522570880:12345-0@lo:503: Request processed in 232us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.455373:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789518012.455441:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522570880:0@lo:503: 00000100:00100000:0.0:1789518012.455857:0:7737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7737:1876445522571008:0@lo:502: 00000100:00100000:0.0:1789518012.455898:0:7737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518012.455929:0:7737:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064f8caa3 going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.455972:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571008 00000100:00100000:1.0:1789518012.455978:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571008 00000100:00100000:1.0:1789518012.456007:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789518012.456013:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083f29342 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7737:x1876445522571008:12345-0@lo:502: 00000100:00100000:1.0:1789518012.456100:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083f29342 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7737:x1876445522571008:12345-0@lo:502: Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.456108:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789518012.456173:0:7737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7737:1876445522571008:0@lo:502: 00000020:01000000:2.0:1789518012.456324:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518012.456336:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518012.456339:0:7737:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789518012.456343:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789518012.456346:0:7737:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:00000080:2.0:1789518012.456369:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518012.456384:0:7737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000073692a3d) 00000020:00000080:2.0:1789518012.456405:0:7737:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789518012.456411:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789518012.456539:0:7737:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789518012.456545:0:7737:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789518012.456552:0:7737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942313f25 00010000:00080000:2.0:1789518012.456585:0:7737:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004ce1c247@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789518012.459973:0:7737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789518012.461307:0:7737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518012.461325:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789518012.461364:0:7737:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789518012.461390:0:7737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd67942313f2c 00000100:00080000:2.0:1789518012.461402:0:7737:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518012.461413:0:7737:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000004ce1c247 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518012.461455:0:7737:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ccefce06 x1876445522571136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518012.461528:0:7737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789518012.461580:0:7737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1789518012.461763:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522571136:0@lo:38: 00000100:00100000:1.0:1789518012.461840:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.462390:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571136 00000100:00100000:2.0:1789518012.462402:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571136 00000100:00100000:2.0:1789518012.462449:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518012.462456:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000401663f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1876445522571136:12345-0@lo:38: 00010000:00080000:2.0:1789518012.462513:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:2.0:1789518012.462563:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd67942313f33 00000004:00100000:2.0:1789518012.462581:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789518012.462587:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789518012.462838:0:7740:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000041c2289 x1876445522571264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518012.462849:0:7740:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1bfacf going to sleep for 0 seconds 00000020:01000000:2.0:1789518012.462990:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518012.462995:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518012.462997:0:7737:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789518012.463000:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518012.463004:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518012.463005:0:7737:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789518012.463008:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789518012.463010:0:7737:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789518012.463034:0:7737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d7af3db0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7737:1876445522571392:0@lo:502: 00000100:00100000:2.0:1789518012.463097:0:7737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.463133:0:7737:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049f47226 going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.463179:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571392 00000100:00100000:1.0:1789518012.463184:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571392 00000100:00100000:0.0:1789518012.463316:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789518012.463325:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8d69db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7737:x1876445522571392:12345-0@lo:502: 00000100:00100000:0.0:1789518012.463455:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8d69db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7737:x1876445522571392:12345-0@lo:502: Request processed in 129us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518012.463489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789518012.463610:0:7737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d7af3db0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7737:1876445522571392:0@lo:502: 00000020:01000000:2.0:1789518012.463637:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518012.463642:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518012.463644:0:7737:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789518012.463647:0:7737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789518012.463808:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789518012.463829:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789518012.463838:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000309e8789/0x8d0fd67942313f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.463849:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000309e8789/0x8d0fd67942313f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518012.463859:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789518012.463863:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e740dd9cd40 from 1 10000000:01000000:0.0:1789518012.463866:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789518012.463895:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000d140116c/0x8d0fd67942313f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.463913:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000d140116c/0x8d0fd67942313f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.463924:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000d140116c/0x8d0fd67942313f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518012.463938:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052c87471 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522571520:0@lo:101: 00000100:00100000:0.0:1789518012.463969:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518012.464004:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064f8caa3 going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.464075:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571520 00000100:00100000:1.0:1789518012.464082:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571520 00000100:00100000:1.0:1789518012.464106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518012.464439:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026a92839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522571520:12345-0@lo:101: 00010000:00010000:1.0:1789518012.464450:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518012.464461:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd24b3ac/0x8d0fd67942313f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313f3a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.464500:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd24b3ac/0x8d0fd67942313f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.464510:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd24b3ac/0x8d0fd67942313f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518012.464528:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd24b3ac, rc 0) 00000100:00100000:1.0:1789518012.464568:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026a92839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522571520:12345-0@lo:101: Request processed in 132us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518012.468662:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052c87471 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522571520:0@lo:101: 00010000:00010000:0.0:1789518012.468694:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000d140116c/0x8d0fd67942313f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.468708:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000d140116c/0x8d0fd67942313f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518012.468798:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052c87471 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522571648:0@lo:501: 00000100:00100000:0.0:1789518012.468859:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518012.468892:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064f8caa3 going to sleep for 11 seconds 00000100:00100000:0.0:1789518012.468917:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571648 00000100:00100000:0.0:1789518012.468924:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571648 00000100:00100000:0.0:1789518012.468955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789518012.468962:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee7d05e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522571648:12345-0@lo:501: 00000100:00100000:0.0:1789518012.469050:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee7d05e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522571648:12345-0@lo:501: Request processed in 89us (191us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518012.469057:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789518012.469093:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052c87471 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522571648:0@lo:501: 10000000:01000000:0.0:1789518012.469119:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789518012.469125:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000d140116c/0x8d0fd67942313f3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.469133:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000d140116c/0x8d0fd67942313f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518012.470085:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518012.480295:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789518012.492448:0:6518:0:(import.c:65:import_set_state_nolock()) 0000000022d71f26 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518012.492603:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000401663f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876445522571136:12345-0@lo:38: Request processed in 30144us (30761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518012.492623:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518012.492768:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518012.492778:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789518012.492786:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789518012.492792:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789518012.492794:0:3636:0:(import.c:65:import_set_state_nolock()) 000000004ce1c247 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789518012.492814:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009c1bfacf): req@00000000041c2289 x1876445522571264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518012.492833:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccefce06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522571136:0@lo:38: 00000100:00100000:1.0:1789518012.492904:0:7740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518012.492940:0:7740:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1bfacf going to sleep for 11 seconds 00000100:00100000:2.0:1789518012.493588:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d68c6ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522571776:0@lo:41: 00000100:00100000:2.0:1789518012.493635:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518012.493718:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571264 00000100:00100000:3.0:1789518012.493727:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571264 00000100:00100000:3.0:1789518012.493762:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571776 00000100:00100000:3.0:1789518012.493765:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571776 00000100:00100000:3.0:1789518012.493778:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518012.493785:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f01a074d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7740:x1876445522571264:12345-0@lo:1000: 00000100:00100000:3.0:1789518012.493886:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f01a074d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7740:x1876445522571264:12345-0@lo:1000: Request processed in 101us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518012.493894:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518012.493911:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518012.493916:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7af3db0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522571776:12345-0@lo:41: 00000004:00000024:3.0:1789518012.493938:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789518012.493973:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7af3db0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522571776:12345-0@lo:41: Request processed in 58us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518012.493980:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518012.494650:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d68c6ef8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522571776:0@lo:41: 00000100:00100000:2.0:1789518012.494683:0:7740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000041c2289 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522571264:0@lo:1000: 00000040:01000000:2.0:1789518012.494719:0:7740:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789518012.494761:0:7740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8556561 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522571904:0@lo:1000: 00000100:00100000:2.0:1789518012.494805:0:7740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.494827:0:7740:0:(client.c:2716:ptlrpc_set_wait()) set 00000000735af370 going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.494897:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522571904 00000100:00100000:1.0:1789518012.494904:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522571904 00000100:00100000:1.0:1789518012.494934:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518012.494953:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7b3b584 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7740:x1876445522571904:12345-0@lo:1000: 00000100:00100000:1.0:1789518012.495071:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7b3b584 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7740:x1876445522571904:12345-0@lo:1000: Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.495078:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518012.495200:0:7740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8556561 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522571904:0@lo:1000: 00000100:00100000:2.0:1789518012.495328:0:7740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8556561 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572032:0@lo:700: 00000100:00100000:2.0:1789518012.495356:0:7740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518012.495378:0:7740:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cee485fb going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.495488:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522572032 00000100:00100000:1.0:1789518012.495493:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522572032 00000100:00100000:1.0:1789518012.495533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518012.495540:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d5896df pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7740:x1876445522572032:12345-0@lo:700: 00000100:00100000:1.0:1789518012.495587:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d5896df pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7740:x1876445522572032:12345-0@lo:700: Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.495594:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518012.495674:0:7740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8556561 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572032:0@lo:700: 00000100:00100000:3.0:1789518012.495848:0:7740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d68c6ef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572160:0@lo:1000: 00000100:00100000:3.0:1789518012.495878:0:7740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518012.495944:0:7740:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003811f49 going to sleep for 11 seconds 00000100:00100000:1.0:1789518012.500045:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522572160 00000100:00100000:1.0:1789518012.500063:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522572160 00000100:00100000:1.0:1789518012.500486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518012.500497:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001118f6d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7740:x1876445522572160:12345-0@lo:1000: 00000100:00100000:1.0:1789518012.500649:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001118f6d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7740:x1876445522572160:12345-0@lo:1000: Request processed in 155us (4770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.500657:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518012.502404:0:7740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d68c6ef8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572160:0@lo:1000: 00000004:00080000:0.0:1789518012.502753:0:7740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000004124e793 with version 0 00000020:00100000:0.0:1789518012.502783:0:7740:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789518012.502791:0:7740:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000052c87471 x1876445522572416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518012.502812:0:7740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052c87471 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572416:0@lo:1000: 00000100:00100000:0.0:1789518012.502873:0:7740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518012.506546:0:7740:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a41825b going to sleep for 11 seconds 00000100:00100000:3.0:1789518012.510048:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522572416 00000100:00100000:3.0:1789518012.510065:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522572416 00000100:00100000:3.0:1789518012.510948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518012.510962:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005fdcf335 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7740:x1876445522572416:12345-0@lo:1000: 00000001:00080000:2.0:1789518012.520495:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1789518012.520515:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789518012.521562:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005fdcf335 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7740:x1876445522572416:12345-0@lo:1000: Request processed in 10596us (18681us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789518012.521589:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1789518012.524644:0:7740:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789518012.524656:0:7740:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789518012.524683:0:7740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052c87471 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572416:0@lo:1000: 00000100:00100000:1.0:1789518012.526441:0:7740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000041c2289 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572544:0@lo:1000: 00000100:00100000:1.0:1789518012.526536:0:7740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518012.527588:0:7740:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1bfacf going to sleep for 11 seconds 00000100:00100000:3.0:1789518012.529340:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522572544 00000100:00100000:3.0:1789518012.529356:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522572544 00000100:00100000:1.0:1789518012.533226:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518012.533242:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000690d1d19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7740:x1876445522572544:12345-0@lo:1000: 00000100:00100000:1.0:1789518012.533400:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000690d1d19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7740:x1876445522572544:12345-0@lo:1000: Request processed in 162us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518012.533408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518012.535052:0:7740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000041c2289 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7740:1876445522572544:0@lo:1000: 00000040:00080000:0.0:1789518012.535092:0:7740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789518012.535139:0:7740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000002db74b56 with version 1 00000040:00080000:0.0:1789518012.537266:0:7740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789518012.537349:0:7740:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789518012.537354:0:7740:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1789518012.537505:0:7738:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000000cfdda3a version 1 rpc_version 1 00000020:00100000:0.0:1789518012.537553:0:7738:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789518012.537563:0:7738:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007b2c7575 x1876445522572800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518012.537601:0:7738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b2c7575 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7738:1876445522572800:0@lo:1000: 00000100:00100000:0.0:1789518012.537667:0:7738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518012.540144:0:7738:0:(client.c:2716:ptlrpc_set_wait()) set 00000000455ea05d going to sleep for 11 seconds 00000100:00100000:3.0:1789518012.540205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522572800 00000100:00100000:3.0:1789518012.540285:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522572800 00000100:00100000:2.0:1789518012.540580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518012.540590:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052c87471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7738:x1876445522572800:12345-0@lo:1000: 00000001:00080000:0.0:1789518012.553685:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789518012.553971:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052c87471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7738:x1876445522572800:12345-0@lo:1000: Request processed in 13377us (16299us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789518012.553986:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789518012.554148:0:7738:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789518012.554153:0:7738:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789518012.554171:0:7738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b2c7575 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7738:1876445522572800:0@lo:1000: 00000020:00000004:0.0:1789518012.902164:0:7770:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789518012.902372:0:7770:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518013.494593:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518014.518265:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518015.541628:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789518015.815599:0:7872:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518015.816897:0:7872:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518016.567122:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518016.999932:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda01d5860 20000000:00000080:3.0:1789518016.999954:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e743aaed400 uarg=0000000000000000 20000000:01000000:3.0:1789518017.000023:0:7920:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789518017.000032:0:7920:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789518017.000038:0:7920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789518017.000138:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789518017.000169:0:7920:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789518017.005084:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518017.005529:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789518017.005571:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789518017.005591:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789518017.005611:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789518017.005636:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.005659:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.005667:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313eae expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.005674:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.005723:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313eae expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.005740:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313eae expref: 17 pid: 6507 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518017.005766:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b2c7575 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1876445522572928:0@lo:104: 00000100:00100000:0.0:1789518017.005870:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518017.005946:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.005955:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 17 pid: 6505 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518017.005963:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1876445522573056:0@lo:104: 00000100:00100000:0.0:1789518017.005982:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca4de601 going to sleep for 11 seconds 00000100:00100000:3.0:1789518017.006695:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789518017.006725:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518017.006763:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522572928 00000100:00100000:3.0:1789518017.006772:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522572928 00000100:00100000:3.0:1789518017.006821:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573056 00000100:00100000:3.0:1789518017.006824:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573056 00000100:00100000:3.0:1789518017.006839:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518017.006849:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c938b336 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:7920:x1876445522572928:12345-0@lo:104: 00010000:00010000:3.0:1789518017.006866:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.006943:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518017.006949:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c938b336 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:7920:x1876445522572928:12345-0@lo:104: Request processed in 102us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518017.006967:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518017.007015:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518017.007021:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057ef1068 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:7920:x1876445522573056:12345-0@lo:104: 00010000:00010000:3.0:1789518017.007028:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007063:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789518017.007068:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057ef1068 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:7920:x1876445522573056:12345-0@lo:104: Request processed in 49us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518017.007294:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789518017.007316:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518017.007323:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007331:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fb8db94 already unused, calling callback (00000000505ff6fc) 10000000:00010000:3.0:1789518017.007335:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007343:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518017.007350:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518017.007356:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518017.007545:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007554:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518017.007585:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007592:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 000000008fb8db94/0x8d0fd67942313eae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313eb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007606:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518017.007608:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007614:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000185ef554 already unused, calling callback (00000000505ff6fc) 10000000:00010000:3.0:1789518017.007616:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.007622:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518017.007627:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518017.007632:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789518017.007933:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518017.007949:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097d672f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522573184:0@lo:103: 00000100:00100000:2.0:1789518017.007997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518017.008059:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518017.008217:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b2c7575 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1876445522572928:0@lo:104: 00000100:00100000:0.0:1789518017.008228:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000badd3cb9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1876445522573056:0@lo:104: 00010000:00010000:0.0:1789518017.008250:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518017.008556:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573184 00000100:00100000:2.0:1789518017.008563:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573184 00010000:00010000:2.0:1789518017.008590:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313eae expref: 18 pid: 6507 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518017.008671:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518017.008679:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000837490eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3639:x1876445522573184:12345-0@lo:103: 00010000:00010000:2.0:1789518017.008693:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518017.008699:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313eae expref: 18 pid: 6507 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518017.008709:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313eae expref: 18 pid: 6507 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518017.008724:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001baee067/0x8d0fd67942313eb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313eae expref: 18 pid: 6507 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518017.008742:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518017.008784:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000837490eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:3639:x1876445522573184:12345-0@lo:103: Request processed in 107us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518017.008791:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518017.009812:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097d672f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522573184:0@lo:103: 00010000:00010000:3.0:1789518017.009959:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.009970:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518017.009995:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010003:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 00000000185ef554/0x8d0fd67942313dc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313dc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010023:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518017.010042:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518017.010044:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518017.010145:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d666cf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522573312:0@lo:103: 00000100:00100000:0.0:1789518017.010204:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518017.010302:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573312 00000100:00100000:3.0:1789518017.010308:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573312 00010000:00010000:3.0:1789518017.010332:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 17 pid: 6505 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518017.010365:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518017.010373:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000badd3cb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:3637:x1876445522573312:12345-0@lo:103: 00010000:00010000:3.0:1789518017.010388:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518017.010393:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 17 pid: 6505 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010402:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 17 pid: 6505 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010414:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001dca7715/0x8d0fd67942313dc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313dc0 expref: 17 pid: 6505 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010429:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010437:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010449:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010454:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010458:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010508:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010514:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002a59de57 already unused, calling callback (000000000903ef61) 00010000:00010000:3.0:1789518017.010518:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010527:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010541:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518017.010549:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518017.010579:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000badd3cb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3637:x1876445522573312:12345-0@lo:103: Request processed in 208us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518017.010594:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518017.010619:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d666cf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522573312:0@lo:103: 00010000:00010000:0.0:1789518017.010760:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.010766:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518017.010770:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a59de57/0x8d0fd67942313f48 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518017.528647:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d666cf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522573440:0@lo:41: 00000100:00100000:2.0:1789518017.528760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518017.528916:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573440 00000100:00100000:3.0:1789518017.528927:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573440 00000100:00100000:3.0:1789518017.528995:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518017.529005:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d1dab96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522573440:12345-0@lo:41: 00000004:00000024:3.0:1789518017.529054:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789518017.529122:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d1dab96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522573440:12345-0@lo:41: Request processed in 118us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518017.529129:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518017.529631:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d666cf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522573440:0@lo:41: 00000100:00100000:2.0:1789518017.530369:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb8b1d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522573568:0@lo:41: 00000100:00100000:2.0:1789518017.530426:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518017.531578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573568 00000100:00100000:1.0:1789518017.531593:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573568 00000100:00100000:1.0:1789518017.531659:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518017.531669:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016731464 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522573568:12345-0@lo:41: 00000004:00000024:1.0:1789518017.531716:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789518017.531813:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016731464 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522573568:12345-0@lo:41: Request processed in 146us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518017.531821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518017.531876:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb8b1d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522573568:0@lo:41: 00000100:00100000:2.0:1789518017.532498:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522573696:0@lo:400: 00000100:00100000:2.0:1789518017.532568:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518017.532626:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003902b4ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522573952:0@lo:400: 00000100:00100000:2.0:1789518017.532657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518017.532679:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518017.532685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0768f58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522573824:0@lo:400: 00000100:00100000:2.0:1789518017.532703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518017.532731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573952 00000100:00100000:2.0:1789518017.532738:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573952 00000100:00100000:2.0:1789518017.532786:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573824 00000100:00100000:2.0:1789518017.532789:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573824 00000100:00100000:2.0:1789518017.532806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518017.532812:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000935db548 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522573952:12345-0@lo:400: 00000100:00100000:2.0:1789518017.532853:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000935db548 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522573952:12345-0@lo:400: Request processed in 42us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518017.532861:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518017.532876:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518017.532881:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024715440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522573824:12345-0@lo:400: 00000100:00100000:2.0:1789518017.532906:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024715440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522573824:12345-0@lo:400: Request processed in 26us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518017.532912:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789518017.532947:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f0768f58 x1876445522573824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518017.532958:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0768f58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522573824:0@lo:400: 00010000:00080000:2.0:1789518017.532967:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003902b4ad x1876445522573952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518017.532973:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003902b4ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522573952:0@lo:400: 00000100:00100000:3.0:1789518017.533862:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522573696 00000100:00100000:3.0:1789518017.533872:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522573696 00000100:00100000:3.0:1789518017.533935:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789518017.533942:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002dd363a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3640:x1876445522573696:12345-0@lo:400: 00000100:00100000:3.0:1789518017.534007:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002dd363a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3640:x1876445522573696:12345-0@lo:400: Request processed in 66us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518017.534014:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789518017.534884:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047c3f7d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522573696:0@lo:400: 00010000:00010000:3.0:1789518017.589886:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518018.295051:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518018.295083:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e74044cd800 from 1 10000000:01000000:0.0:1789518018.295089:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518018.295142:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000002a59de57/0x8d0fd67942313f4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518018.295156:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000002a59de57/0x8d0fd67942313f4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518018.295168:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000002a59de57/0x8d0fd67942313f4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518018.295195:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b2c7575 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574080:0@lo:101: 00000100:00100000:0.0:1789518018.295280:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518018.295335:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd6da7e8 going to sleep for 11 seconds 00000100:00100000:1.0:1789518018.296833:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574080 00000100:00100000:1.0:1789518018.296848:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574080 00000100:00100000:1.0:1789518018.297014:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789518018.297024:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000633878a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522574080:12345-0@lo:101: 00010000:00010000:1.0:1789518018.297044:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518018.297066:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db3a2bcf/0x8d0fd67942313f56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313f4f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.297097:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db3a2bcf/0x8d0fd67942313f56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.297110:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db3a2bcf/0x8d0fd67942313f56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.297125:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db3a2bcf, rc 0) 00000100:00100000:1.0:1789518018.297198:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000633878a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522574080:12345-0@lo:101: Request processed in 176us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518018.297205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789518018.297229:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b2c7575 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574080:0@lo:101: 00010000:00010000:2.0:1789518018.297248:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000002a59de57/0x8d0fd67942313f4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518018.297256:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000002a59de57/0x8d0fd67942313f4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518018.297600:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fa37918 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574208:0@lo:501: 00000100:00100000:2.0:1789518018.297642:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518018.297866:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047f7abbd going to sleep for 11 seconds 00000100:00100000:2.0:1789518018.297890:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574208 00000100:00100000:2.0:1789518018.297896:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574208 00000100:00100000:2.0:1789518018.297930:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789518018.297937:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e1101b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522574208:12345-0@lo:501: 00000100:00100000:2.0:1789518018.298079:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e1101b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522574208:12345-0@lo:501: Request processed in 142us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518018.298087:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789518018.298122:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fa37918 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574208:0@lo:501: 00000100:00100000:2.0:1789518018.298155:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fa37918 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574336:0@lo:503: 00000100:00100000:2.0:1789518018.298197:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518018.298209:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047f7abbd going to sleep for 11 seconds 00000100:00100000:2.0:1789518018.298220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574336 00000100:00100000:2.0:1789518018.298224:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574336 00000100:00100000:2.0:1789518018.298240:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789518018.298244:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6732d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522574336:12345-0@lo:503: 00000100:00100000:2.0:1789518018.298327:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6732d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522574336:12345-0@lo:503: Request processed in 81us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518018.298334:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789518018.298368:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fa37918 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574336:0@lo:503: 00000100:00100000:2.0:1789518018.306060:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003fa37918 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7954:1876445522574464:0@lo:502: 00000100:00100000:2.0:1789518018.306170:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518018.306263:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc1088de going to sleep for 11 seconds 00000100:00100000:1.0:1789518018.306328:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574464 00000100:00100000:1.0:1789518018.306338:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574464 00000100:00100000:1.0:1789518018.306430:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789518018.306440:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051a7827a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7954:x1876445522574464:12345-0@lo:502: 00000100:00100000:1.0:1789518018.306632:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051a7827a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7954:x1876445522574464:12345-0@lo:502: Request processed in 194us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518018.306640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789518018.306923:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003fa37918 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7954:1876445522574464:0@lo:502: 00000020:01000000:2.0:1789518018.306955:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518018.306967:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518018.306970:0:7954:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789518018.306979:0:7954:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e74044cd800 00000020:00000080:2.0:1789518018.306983:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789518018.307030:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7954:1876445522574592:0@lo:502: 00000100:00100000:2.0:1789518018.307075:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518018.307101:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a487180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518018.307216:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574592 00000100:00100000:1.0:1789518018.307222:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574592 00000100:00100000:1.0:1789518018.307283:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518018.307291:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7954:x1876445522574592:12345-0@lo:502: 00000100:00100000:1.0:1789518018.307368:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:7954:x1876445522574592:12345-0@lo:502: Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518018.307375:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518018.307436:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7954:1876445522574592:0@lo:502: 00000020:01000000:2.0:1789518018.307453:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518018.307457:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518018.307460:0:7954:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789518018.307494:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789518018.307896:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789518018.307928:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518018.307940:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.307953:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518018.307965:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518018.307976:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7439644800 from 1 10000000:01000000:1.0:1789518018.307980:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518018.308012:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.308021:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.308030:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518018.308046:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574720:0@lo:101: 00000100:00100000:1.0:1789518018.308085:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518018.308152:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518018.308195:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574720 00000100:00100000:2.0:1789518018.308201:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574720 00000100:00100000:2.0:1789518018.308268:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518018.308278:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522574720:12345-0@lo:101: 00010000:00010000:2.0:1789518018.308289:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518018.308310:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313f5d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518018.308336:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518018.308350:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518018.308360:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dce000, rc 0) 00000100:00100000:2.0:1789518018.308400:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522574720:12345-0@lo:101: Request processed in 124us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518018.308408:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789518018.308496:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574720:0@lo:101: 00010000:00010000:1.0:1789518018.308515:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.308526:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518018.308582:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574848:0@lo:501: 00000100:00100000:1.0:1789518018.308616:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518018.308632:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518018.308649:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574848 00000100:00100000:1.0:1789518018.308653:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574848 00000100:00100000:1.0:1789518018.308696:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789518018.308704:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522574848:12345-0@lo:501: 00000100:00100000:1.0:1789518018.311077:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522574848:12345-0@lo:501: Request processed in 2362us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518018.311104:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574848:0@lo:501: 00000100:00100000:1.0:1789518018.311104:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518018.311174:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574976:0@lo:503: 00000100:00100000:3.0:1789518018.311231:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518018.311264:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7404deb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518018.311427:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522574976 00000100:00100000:1.0:1789518018.311435:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522574976 00000100:00100000:1.0:1789518018.311511:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789518018.311520:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522574976:12345-0@lo:503: 00000100:00100000:1.0:1789518018.311623:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522574976:12345-0@lo:503: Request processed in 104us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518018.311629:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518018.311710:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522574976:0@lo:503: 00000100:00100000:3.0:1789518018.312105:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7955:1876445522575104:0@lo:502: 00000100:00100000:3.0:1789518018.312153:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518018.312177:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7404deb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518018.314117:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522575104 00000100:00100000:1.0:1789518018.314135:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522575104 00000100:00100000:1.0:1789518018.314211:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789518018.314224:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:7955:x1876445522575104:12345-0@lo:502: 00000100:00100000:1.0:1789518018.314413:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:7955:x1876445522575104:12345-0@lo:502: Request processed in 191us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518018.314423:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789518018.314442:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7955:1876445522575104:0@lo:502: 00000020:01000000:3.0:1789518018.314520:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518018.314533:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518018.314535:0:7955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789518018.314544:0:7955:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7439644800 00000020:00000080:3.0:1789518018.314547:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518018.314587:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7955:1876445522575232:0@lo:502: 00000100:00100000:3.0:1789518018.314807:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518018.314853:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e744172f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518018.315187:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522575232 00000100:00100000:1.0:1789518018.315194:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522575232 00000100:00100000:1.0:1789518018.315231:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789518018.315240:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:7955:x1876445522575232:12345-0@lo:502: 00000100:00100000:1.0:1789518018.315344:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:7955:x1876445522575232:12345-0@lo:502: Request processed in 104us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518018.315352:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789518018.315436:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:7955:1876445522575232:0@lo:502: 00000020:01000000:2.0:1789518018.315513:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518018.315521:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518018.315523:0:7955:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789518018.315528:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789518018.315788:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789518018.315812:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518018.315822:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518018.315848:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518018.615681:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518019.639115:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518020.663197:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518021.691541:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518022.649030:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522575360:0@lo:41: 00000100:00100000:2.0:1789518022.649105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518022.653540:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522575360 00000100:00100000:2.0:1789518022.653558:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522575360 00000100:00100000:2.0:1789518022.653631:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518022.653644:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522575360:12345-0@lo:41: 00000004:00000024:2.0:1789518022.653692:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789518022.653778:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522575360:12345-0@lo:41: Request processed in 137us (4673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518022.653792:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518022.653829:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522575488:0@lo:41: 00000100:00100000:2.0:1789518022.653869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518022.653941:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522575360:0@lo:41: 00000100:00100000:2.0:1789518022.653960:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522575488 00000100:00100000:2.0:1789518022.653962:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522575488 00000100:00100000:2.0:1789518022.653978:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518022.653983:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522575488:12345-0@lo:41: 00000004:00000024:2.0:1789518022.653999:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789518022.654029:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522575488:12345-0@lo:41: Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518022.654035:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518022.654057:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522575488:0@lo:41: 00000100:00100000:1.0:1789518022.655415:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522575616:0@lo:400: 00000100:00100000:1.0:1789518022.655494:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518022.655532:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518022.655538:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522575744:0@lo:400: 00000100:00100000:1.0:1789518022.655564:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518022.656320:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522575872:0@lo:400: 00000100:00100000:2.0:1789518022.656360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518022.656400:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522575616 00000100:00100000:2.0:1789518022.656408:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522575616 00000100:00100000:2.0:1789518022.656459:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789518022.656486:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3637:x1876445522575616:12345-0@lo:400: 00000100:00100000:2.0:1789518022.656535:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3637:x1876445522575616:12345-0@lo:400: Request processed in 51us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518022.656542:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789518022.656575:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522575744 00000100:00100000:2.0:1789518022.656578:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522575744 00000100:00100000:2.0:1789518022.656601:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522575872 00000100:00100000:2.0:1789518022.656604:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522575872 00000100:00100000:2.0:1789518022.656629:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518022.656634:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522575744:12345-0@lo:400: 00000100:00100000:2.0:1789518022.656664:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522575744:12345-0@lo:400: Request processed in 30us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518022.656669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518022.656679:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518022.656684:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522575872:12345-0@lo:400: 00000100:00100000:2.0:1789518022.656709:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522575872:12345-0@lo:400: Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518022.656714:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789518022.656973:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e740480c000 x1876445522575872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518022.656987:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522575872:0@lo:400: 00010000:00080000:2.0:1789518022.657011:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e740480f100 x1876445522575744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518022.657020:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522575744:0@lo:400: 00000100:00100000:2.0:1789518022.657027:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522575616:0@lo:400: 00010000:00010000:2.0:1789518022.712943:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518023.735113:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518024.757955:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518025.781751:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518026.805713:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789518027.288631:0:8420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789518027.288637:0:8420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789518027.288638:0:8420:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789518027.288780:0:8420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e7435dc1800 00000020:01000004:2.0:1789518027.288798:0:8420:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789518027.288811:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789518027.288830:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e743a5719c0) 00000020:00000080:2.0:1789518027.288848:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789518027.328549:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789518027.328602:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789518027.360392:0:8420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789518027.360789:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789518027.360803:0:8420:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789518027.360816:0:8420:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8d0fd67942313f72 00000020:01000004:0.0:1789518027.360824:0:8420:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789518027.360847:0:8420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789518027.360851:0:8420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789518027.360858:0:8420:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789518027.360863:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789518027.360877:0:8420:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e743b2519c0) 00000020:00000080:0.0:1789518027.360889:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1789518027.367877:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518027.370788:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789518027.370806:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789518027.371417:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789518027.371425:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789518027.373739:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789518027.373751:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789518027.379760:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518027.379961:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789518027.379968:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789518027.388239:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789518027.388256:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789518027.421126:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518027.421404:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518027.421412:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789518027.422888:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789518027.422901:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789518027.428246:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789518027.428263:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789518027.431376:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518027.431796:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789518027.431805:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789518027.432902:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789518027.432913:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789518027.479995:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518027.480595:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518027.480603:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789518027.483868:0:8420:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518027.483884:0:8420:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789518027.484922:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789518027.484960:0:8420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789518027.484966:0:8420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789518027.508915:0:8420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789518027.508955:0:8420:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789518027.508959:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789518027.508960:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518027.508962:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518027.508963:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518027.508964:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518027.508964:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518027.508965:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518027.508966:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518027.508967:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518027.508969:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518027.508970:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518027.508973:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789518027.509038:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518027.509039:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518027.509040:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518027.509040:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518027.509041:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518027.509042:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518027.509042:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518027.509043:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518027.509044:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518027.509044:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518027.509045:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518027.509088:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789518027.509110:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522576000:0@lo:253: 00000100:00100000:0.0:1789518027.509194:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.509315:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f27a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518027.509372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576000 00000100:00100000:3.0:1789518027.509391:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576000 00000100:00100000:3.0:1789518027.509846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789518027.509860:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522576000:12345-0@lo:253: 20000000:01000000:3.0:1789518027.509896:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789518027.509901:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789518027.509906:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789518027.509910:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789518027.510180:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518027.510321:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789518027.510336:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789518027.510352:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789518027.510358:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789518027.510369:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789518027.510396:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789518027.510515:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789518027.510532:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:3.0:1789518027.510534:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:3.0:1789518027.510547:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789518027.510553:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789518027.510567:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789518027.510571:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:3.0:1789518027.510583:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789518027.510602:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789518027.510617:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789518027.510834:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789518027.510910:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789518027.510921:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:3.0:1789518027.510923:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:3.0:1789518027.510937:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789518027.510942:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789518027.510954:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789518027.510959:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:3.0:1789518027.510986:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789518027.510994:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789518027.511006:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789518027.511020:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789518027.511393:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789518027.511408:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:3.0:1789518027.511409:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:3.0:1789518027.511424:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789518027.511430:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789518027.511443:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789518027.511447:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:3.0:1789518027.511460:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789518027.511958:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789518027.511992:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789518027.512009:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789518027.512024:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789518027.512027:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789518027.512031:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789518027.512090:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789518027.512093:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789518027.512891:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1789518027.512931:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1789518027.512946:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789518027.513245:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789518027.513278:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789518027.513295:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1789518027.513304:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789518027.513306:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789518027.514570:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1789518027.514606:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1789518027.514615:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789518027.514733:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789518027.514756:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789518027.514772:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789518027.514781:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789518027.514783:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789518027.515806:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789518027.515839:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789518027.515855:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789518027.516121:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789518027.516144:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789518027.516161:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789518027.516173:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789518027.516175:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789518027.516588:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789518027.516825:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789518027.516838:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789518027.516845:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1789518027.516859:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789518027.516881:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.516920:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e74421c2400/0x8d0fd67942313e4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.516926:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.516930:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e740165da00/0x8d0fd67942313efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.516933:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030c00/0x8d0fd67942313f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.516937:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e740165de00/0x8d0fd67942313f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.516942:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.517031:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e740165de00/0x8d0fd67942313f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.517043:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e740165de00/0x8d0fd67942313f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.517057:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576128:0@lo:104: 00000100:00100000:1.0:1789518027.517122:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518027.517209:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030c00/0x8d0fd67942313f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.517217:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7400030c00/0x8d0fd67942313f17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 18 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.517233:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576256:0@lo:104: 00000100:00100000:1.0:1789518027.517258:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518027.517338:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e740165da00/0x8d0fd67942313efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.517347:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e740165da00/0x8d0fd67942313efb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 18 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.517355:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576384:0@lo:104: 00000100:00100000:1.0:1789518027.517376:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.517453:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576128 00000100:00100000:3.0:1789518027.517492:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576128 00000100:00100000:3.0:1789518027.517529:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576256 00000100:00100000:3.0:1789518027.517532:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576256 00000100:00100000:3.0:1789518027.517546:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518027.517556:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522576128:12345-0@lo:104: 00010000:00010000:3.0:1789518027.517570:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.517626:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518027.517644:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522576128:12345-0@lo:104: Request processed in 79us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.517658:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518027.517677:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789518027.517845:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518027.517853:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.517862:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518027.517867:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.517876:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518027.517883:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518027.517889:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518027.517927:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.517934:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518027.517952:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.517960:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.517986:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.517988:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.517990:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518027.518138:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522576256:12345-0@lo:104: 00010000:00010000:3.0:1789518027.518147:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.518207:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518027.518213:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522576256:12345-0@lo:104: Request processed in 531us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.518220:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789518027.518266:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518027.518272:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.518289:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3e00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518027.518292:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.518299:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518027.518305:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518027.518310:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518027.518325:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.518331:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518027.518356:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.518363:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942313f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f17 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.518376:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.518388:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.518391:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518027.518431:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522576640:0@lo:103: 00000100:00100000:3.0:1789518027.518494:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.518579:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576640 00000100:00100000:0.0:1789518027.518584:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576640 00010000:00010000:0.0:1789518027.518606:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030c00/0x8d0fd67942313f17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 19 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.518640:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518027.518663:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3637:x1876445522576640:12345-0@lo:103: 00010000:00010000:0.0:1789518027.518675:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518027.518680:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030c00/0x8d0fd67942313f17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 19 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.518698:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030c00/0x8d0fd67942313f17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 19 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.518714:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518027.518751:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3637:x1876445522576640:12345-0@lo:103: Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.518758:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518027.518931:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522576640:0@lo:103: 10000000:01000000:1.0:1789518027.519227:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789518027.519232:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789518027.519235:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518027.519258:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519268:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519277:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.519291:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522576768:0@lo:101: 00000100:00100000:1.0:1789518027.519323:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.519345:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a487c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.519363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576768 00000100:00100000:1.0:1789518027.519368:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576768 00000100:00100000:1.0:1789518027.519408:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789518027.519415:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522576768:12345-0@lo:101: 00010000:00010000:1.0:1789518027.519435:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518027.519445:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313f87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519491:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519501:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519513:0:6507:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519526:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519533:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d200, rc 0) 00000100:00100000:1.0:1789518027.519574:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522576768:12345-0@lo:101: Request processed in 159us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.519580:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1789518027.519623:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.519645:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313ec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.519834:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522576768:0@lo:101: 00010000:00010000:0.0:1789518027.519848:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.519855:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.519984:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576896:0@lo:104: 00000100:00100000:1.0:1789518027.520017:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518027.520044:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e74421c2400/0x8d0fd67942313e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.520065:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e74421c2400/0x8d0fd67942313e4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 19 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.520073:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522577024:0@lo:104: 00000100:00100000:1.0:1789518027.520109:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.520121:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a487300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.520134:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576128:0@lo:104: 00010000:00010000:1.0:1789518027.520143:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030c00/0x8d0fd67942313f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313f10 expref: 19 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.520154:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576256:0@lo:104: 00000100:00100000:3.0:1789518027.520292:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576384 00000100:00100000:3.0:1789518027.520297:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576384 00000100:00100000:3.0:1789518027.520322:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576896 00000100:00100000:3.0:1789518027.520324:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576896 00000100:00100000:3.0:1789518027.520333:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577024 00000100:00100000:3.0:1789518027.520335:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577024 00000100:00100000:3.0:1789518027.520346:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518027.520355:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6506:x1876445522576384:12345-0@lo:104: 00010000:00010000:3.0:1789518027.520365:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.520436:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518027.520442:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6506:x1876445522576384:12345-0@lo:104: Request processed in 89us (3065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.520447:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518027.520484:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518027.520492:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522576896:12345-0@lo:104: 00010000:00010000:3.0:1789518027.520499:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.520543:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789518027.520549:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522576896:12345-0@lo:104: Request processed in 59us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.520555:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518027.520567:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518027.520573:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522577024:12345-0@lo:104: 00010000:00010000:3.0:1789518027.520581:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.520607:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789518027.520612:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522577024:12345-0@lo:104: Request processed in 39us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.520617:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789518027.520867:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789518027.520875:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.520882:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166dc00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518027.520887:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.520895:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518027.520914:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518027.520919:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518027.520944:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.520951:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518027.520982:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.520991:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740166dc00/0x8d0fd67942313ef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521004:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518027.521007:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521013:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165c400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518027.521017:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521024:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518027.521029:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518027.521033:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518027.521054:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521060:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518027.521067:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521073:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740165c400/0x8d0fd67942313ebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521083:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518027.521086:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521090:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518027.521093:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521099:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518027.521105:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518027.521110:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518027.521121:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521127:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518027.521131:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521147:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c3200/0x8d0fd67942313e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313e4c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.521157:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.521159:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.521161:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.521169:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.521174:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518027.521272:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518027.521286:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522577152:0@lo:103: 00000100:00100000:3.0:1789518027.521326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.521450:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576384:0@lo:104: 00000100:00100000:1.0:1789518027.521483:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522576896:0@lo:104: 00000100:00100000:1.0:1789518027.521493:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522577024:0@lo:104: 00010000:00010000:1.0:1789518027.521520:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518027.521594:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522577280:0@lo:103: 00000100:00100000:3.0:1789518027.521613:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.521641:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789518027.521645:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522576512:0@lo:103: 00000100:00100000:3.0:1789518027.521663:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.521671:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522577408:0@lo:103: 00000100:00100000:3.0:1789518027.521690:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.521877:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577152 00000100:00100000:0.0:1789518027.521884:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577152 00010000:00010000:0.0:1789518027.521912:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e740165da00/0x8d0fd67942313efb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 19 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.521930:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577280 00000100:00100000:0.0:1789518027.521932:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577280 00010000:00010000:0.0:1789518027.521939:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313ec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 20 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.521945:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522576512 00000100:00100000:0.0:1789518027.521946:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522576512 00010000:00010000:0.0:1789518027.521951:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e740165de00/0x8d0fd67942313f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 21 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.521955:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577408 00000100:00100000:0.0:1789518027.521957:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577408 00010000:00010000:0.0:1789518027.521961:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e74421c2400/0x8d0fd67942313e4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 22 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.521968:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518027.521973:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3637:x1876445522577152:12345-0@lo:103: 00010000:00010000:0.0:1789518027.522061:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518027.522067:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e740165da00/0x8d0fd67942313efb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 22 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522077:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e740165da00/0x8d0fd67942313efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 22 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522092:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740165da00/0x8d0fd67942313efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313ef4 expref: 22 pid: 6506 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522106:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518027.522154:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3637:x1876445522577152:12345-0@lo:103: Request processed in 179us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.522160:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518027.522176:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518027.522182:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3639:x1876445522577280:12345-0@lo:103: 00010000:00010000:0.0:1789518027.522189:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518027.522194:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313ec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 20 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522201:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 20 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522211:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313ec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313ebc expref: 20 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522220:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518027.522248:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3639:x1876445522577280:12345-0@lo:103: Request processed in 67us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.522254:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518027.522273:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518027.522278:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3639:x1876445522576512:12345-0@lo:103: 00010000:00010000:0.0:1789518027.522286:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518027.522291:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e740165de00/0x8d0fd67942313f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522300:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e740165de00/0x8d0fd67942313f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522309:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740165de00/0x8d0fd67942313f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313f3a expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522318:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518027.522341:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:3639:x1876445522576512:12345-0@lo:103: Request processed in 63us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.522347:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518027.522359:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518027.522365:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3639:x1876445522577408:12345-0@lo:103: 00010000:00010000:0.0:1789518027.522372:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518027.522375:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e74421c2400/0x8d0fd67942313e4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 16 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522399:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e74421c2400/0x8d0fd67942313e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 16 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522408:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e74421c2400/0x8d0fd67942313e4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313e45 expref: 16 pid: 6505 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522421:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522438:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522455:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522494:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522502:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522508:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522514:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518027.522519:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522526:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522540:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522546:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.522568:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.522590:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6497:1876445522577536:0@lo:105: 00000100:00100000:0.0:1789518027.522621:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518027.522881:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.522890:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518027.522899:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789518027.523348:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74414d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518027.523404:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522576512:0@lo:103: 00000100:00100000:0.0:1789518027.523413:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522577280:0@lo:103: 00000100:00100000:0.0:1789518027.523489:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518027.523513:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577536 00000100:00100000:0.0:1789518027.523519:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577536 00000100:00100000:0.0:1789518027.523549:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518027.523556:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743aaec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6497:x1876445522577536:12345-0@lo:105: 00010000:00010000:0.0:1789518027.523567:0:6496:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.523577:0:6496:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.523586:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.523594:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.523601:0:6496:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.523628:0:6496:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8e7435f0ce00) 00000100:00100000:3.0:1789518027.523845:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522577152:0@lo:103: 00010000:00010000:1.0:1789518027.524117:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.524137:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.524210:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522577664:0@lo:501: 00000100:00100000:1.0:1789518027.524253:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.524277:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a487300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.524296:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577664 00000100:00100000:1.0:1789518027.524300:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577664 00000100:00100000:1.0:1789518027.524326:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789518027.524332:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522577664:12345-0@lo:501: 00000100:00100000:1.0:1789518027.524491:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522577664:12345-0@lo:501: Request processed in 157us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.524499:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789518027.524538:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522577664:0@lo:501: 00000100:00100000:1.0:1789518027.524565:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522577792:0@lo:503: 00000100:00100000:1.0:1789518027.524603:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.524616:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a487300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.524628:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577792 00000100:00100000:1.0:1789518027.524644:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577792 00000100:00100000:0.0:1789518027.525332:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743aaec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6497:x1876445522577536:12345-0@lo:105: Request processed in 1773us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.525342:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518027.525530:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789518027.525539:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522577792:12345-0@lo:503: 00000100:00100000:1.0:1789518027.525623:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522577792:12345-0@lo:503: Request processed in 85us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.525841:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789518027.525900:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522577792:0@lo:503: 00000100:00100000:1.0:1789518027.526292:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8443:1876445522577920:0@lo:502: 00000100:00100000:1.0:1789518027.526336:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.526364:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522577920 00000100:00100000:1.0:1789518027.526371:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522577920 00000100:00100000:1.0:1789518027.526878:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518027.526888:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:8443:x1876445522577920:12345-0@lo:502: 00000100:00100000:1.0:1789518027.527875:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:8443:x1876445522577920:12345-0@lo:502: Request processed in 985us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.527885:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518027.527942:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a487240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.527965:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8443:1876445522577920:0@lo:502: 00000020:01000000:1.0:1789518027.528195:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518027.528203:0:8443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789518027.528211:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518027.528214:0:8443:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789518027.528218:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789518027.528222:0:8443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:1.0:1789518027.528247:0:8443:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789518027.528250:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518027.528268:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e74217ecd40) 00000020:00000080:1.0:1789518027.528305:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789518027.528312:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789518027.528411:0:8443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789518027.528417:0:8443:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789518027.528424:0:8443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942313f9c 00010000:00080000:1.0:1789518027.528456:0:8443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7301977800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789518027.530418:0:8443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-5 is initialized 00000100:00100000:3.0:1789518027.533657:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6497:1876445522577536:0@lo:105: 00010000:00010000:3.0:1789518027.533709:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.533724:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0da00/0x8d0fd67942313f80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.533738:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518027.533822:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3639:x1876445522577408:12345-0@lo:103: Request processed in 11456us (12136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.533832:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518027.534346:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522577408:0@lo:103: 00000100:00100000:3.0:1789518027.535523:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:8420:x1876445522576000:12345-0@lo:253: Request processed in 25603us (26264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.535537:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789518027.535807:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522576000:0@lo:253: 10000000:01000000:0.0:1789518027.535824:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789518027.535828:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518027.535829:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518027.535831:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518027.535833:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789518027.535834:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518027.535835:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518027.535836:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518027.535838:0:8420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789518027.535840:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518027.535842:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789518027.535865:0:8420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e7435dc1800 from lustre-OST0000 10000000:01000000:0.0:1789518027.535897:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789518027.535901:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789518027.535910:0:8420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e740dd9cd40 local copy 10000000:01000000:0.0:1789518027.535915:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789518027.535955:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.535967:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.536110:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.536133:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578048:0@lo:101: 00000100:00100000:0.0:1789518027.536178:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.536235:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f27600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.536289:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578048 00000100:00100000:1.0:1789518027.536303:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578048 00000100:00100000:1.0:1789518027.536353:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518027.536363:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:8420:x1876445522578048:12345-0@lo:101: 00010000:00010000:1.0:1789518027.536377:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518027.536400:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0dc00/0x8d0fd67942313faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313fa3 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.536425:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0dc00/0x8d0fd67942313faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313fa3 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.536437:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0dc00/0x8d0fd67942313faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313fa3 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.536446:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0dc00, rc 0) 00000100:00100000:1.0:1789518027.536508:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578048:12345-0@lo:101: Request processed in 146us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.536515:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789518027.536591:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578048:0@lo:101: 00010000:00010000:0.0:1789518027.536605:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.536615:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.536855:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578176:0@lo:501: 00000100:00100000:0.0:1789518027.536881:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.537025:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f27600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.537851:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578176 00000100:00100000:1.0:1789518027.537862:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578176 00000100:00100000:1.0:1789518027.537944:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789518027.537954:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578176:12345-0@lo:501: 00000100:00100000:1.0:1789518027.538186:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578176:12345-0@lo:501: Request processed in 233us (1302us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518027.538195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789518027.538284:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578176:0@lo:501: 10000000:01000000:2.0:1789518027.538304:0:8420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789518027.538333:0:8420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789518027.538340:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538350:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538358:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538390:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518027.538424:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e7435dc1800 10000000:01000000:2.0:1789518027.538429:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789518027.538435:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789518027.538454:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518027.538458:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789518027.538495:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789518027.538545:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538553:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538577:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.538596:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578304:0@lo:101: 00000100:00100000:2.0:1789518027.538640:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.538867:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578304 00000100:00100000:2.0:1789518027.538873:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578304 00000100:00100000:2.0:1789518027.538898:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789518027.538906:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578304:12345-0@lo:101: 00010000:00010000:2.0:1789518027.538915:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518027.538926:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313fb1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538946:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538956:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.538963:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf800, rc 0) 00000100:00100000:2.0:1789518027.539140:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:8420:x1876445522578304:12345-0@lo:101: Request processed in 234us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.539147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789518027.539186:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.539203:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578304:0@lo:101: 00010000:00010000:2.0:1789518027.539215:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.539236:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.539311:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578432:0@lo:501: 00000100:00100000:2.0:1789518027.539340:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.539360:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578432 00000100:00100000:2.0:1789518027.539364:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578432 00000100:00100000:2.0:1789518027.539394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518027.539400:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:8420:x1876445522578432:12345-0@lo:501: 00000100:00100000:2.0:1789518027.539524:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:8420:x1876445522578432:12345-0@lo:501: Request processed in 123us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.539531:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518027.539553:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.539563:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578432:0@lo:501: 00000100:00100000:2.0:1789518027.539587:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578560:0@lo:503: 00000100:00100000:2.0:1789518027.539625:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518027.539896:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518027.539904:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.539912:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:1.0:1789518027.539923:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.539931:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518027.539939:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518027.539944:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518027.539966:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.539972:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518027.540006:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.540013:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942313fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd67942313faa expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.540026:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518027.540027:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518027.540029:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518027.540038:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518027.540200:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522578688:0@lo:103: 00000100:00100000:1.0:1789518027.540237:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.540270:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578688 00000100:00100000:1.0:1789518027.540275:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578688 00000100:00100000:1.0:1789518027.540312:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518027.540319:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3638:x1876445522578688:12345-0@lo:103: 00010000:00010000:1.0:1789518027.540330:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518027.540350:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0dc00/0x8d0fd67942313faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942313fa3 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.540364:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518027.540409:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3638:x1876445522578688:12345-0@lo:103: Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.540416:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518027.540448:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522578688:0@lo:103: 00000100:00100000:2.0:1789518027.540883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578560 00000100:00100000:2.0:1789518027.540890:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578560 00000100:00100000:2.0:1789518027.540910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789518027.540915:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578560:12345-0@lo:503: 00000040:01000000:3.0:1789518027.543245:0:8443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789518027.543270:0:8443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789518027.543523:0:8443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518027.543871:0:8443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518027.543958:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789518027.544182:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:0.0:1789518027.544914:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.545344:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578560:12345-0@lo:503: Request processed in 4423us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.545358:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789518027.545520:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578560:0@lo:503: 00000040:00080000:3.0:1789518027.546118:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518027.546214:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578816:0@lo:502: 00000100:00100000:3.0:1789518027.546278:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.546313:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74395c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.546436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578816 00000100:00100000:1.0:1789518027.546445:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578816 00000100:00100000:1.0:1789518027.546518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789518027.546527:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578816:12345-0@lo:502: 00000100:00100000:1.0:1789518027.546965:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578816:12345-0@lo:502: Request processed in 438us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.546974:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789518027.547190:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578816:0@lo:502: 00000040:00080000:0.0:1789518027.548242:0:8444:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518027.548249:0:8444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1789518027.549225:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789518027.549277:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789518027.549294:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789518027.549307:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789518027.549334:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789518027.549349:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789518027.549414:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578944:0@lo:502: 00000100:00100000:3.0:1789518027.549575:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.549622:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74395c9180 going to sleep for 11 seconds 00000020:00000080:1.0:1789518027.550332:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518027.550347:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789518027.550404:0:8443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789518027.550429:0:8443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd67942313fbf 00000100:00080000:1.0:1789518027.550438:0:8443:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518027.550449:0:8443:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e7301977800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518027.550506:0:8443:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7301964e00 x1876445522579072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518027.550529:0:8443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789518027.550611:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522579328:0@lo:400: 00000100:00100000:2.0:1789518027.550814:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522578944 00000100:00100000:2.0:1789518027.550823:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522578944 00000100:00100000:2.0:1789518027.550880:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789518027.550890:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578944:12345-0@lo:502: 00000100:00100000:0.0:1789518027.552256:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522579072:0@lo:8: 00000100:00100000:1.0:1789518027.553530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.553589:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518027.553611:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522579456:0@lo:400: 00000100:00100000:1.0:1789518027.553675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.554170:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579328 00000100:00100000:3.0:1789518027.554180:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579328 00000100:00100000:3.0:1789518027.554233:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518027.554243:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522579328:12345-0@lo:400: 00000100:00100000:3.0:1789518027.554304:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522579328:12345-0@lo:400: Request processed in 63us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.554312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518027.554437:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.554604:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522579328:0@lo:400: 00000100:00100000:1.0:1789518027.554758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522579200:0@lo:400: 00000100:00100000:1.0:1789518027.554787:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.554911:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579072 00000100:00100000:3.0:1789518027.554917:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579072 00000100:00100000:3.0:1789518027.554940:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518027.554945:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1876445522579072:12345-0@lo:8: 00010000:00020000:3.0:1789518027.554964:0:8427:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789518027.555284:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1876445522579072:12345-0@lo:8: Request processed in 336us (846us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518027.555293:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789518027.555364:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7301977800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518027.555370:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518027.555374:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522579072:0@lo:8: 00000100:00100000:2.0:1789518027.555576:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8420:x1876445522578944:12345-0@lo:502: Request processed in 4686us (5999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.555585:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789518027.555704:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522578944:0@lo:502: 00000040:00080000:3.0:1789518027.555796:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789518027.555812:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789518027.556863:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518027.556875:0:8446:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789518027.556882:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518027.556884:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789518027.556890:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518027.556914:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e74317ccd40) 00000020:00000080:3.0:1789518027.556940:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789518027.556947:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789518027.557177:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7435dc1800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789518027.557187:0:8446:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789518027.557194:0:8446:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8d0fd67942313fcd 00000020:01000000:0.0:1789518027.557619:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518027.557626:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518027.557628:0:8443:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789518027.557641:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518027.557645:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518027.557647:0:8443:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518027.557650:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518027.557659:0:8443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789518027.557700:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8443:1876445522579712:0@lo:502: 00000100:00100000:0.0:1789518027.557772:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.557823:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405736600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.558782:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518027.558796:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522579584:0@lo:400: 00000100:00100000:1.0:1789518027.558837:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.558877:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579584 00000100:00100000:1.0:1789518027.558884:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579584 00000100:00100000:1.0:1789518027.558923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518027.558932:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522579584:12345-0@lo:400: 00000100:00100000:1.0:1789518027.559182:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522579584:12345-0@lo:400: Request processed in 250us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.559192:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518027.559223:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579712 00000100:00100000:1.0:1789518027.559228:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579712 00000100:00100000:1.0:1789518027.559252:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789518027.559258:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8443:x1876445522579712:12345-0@lo:502: 00000100:00100000:1.0:1789518027.559366:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:8443:x1876445522579712:12345-0@lo:502: Request processed in 107us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.559373:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789518027.559442:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8443:1876445522579712:0@lo:502: 00000020:01000000:1.0:1789518027.559493:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518027.559499:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518027.559501:0:8443:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789518027.559506:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789518027.559575:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789518027.559593:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789518027.559603:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.559614:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518027.559623:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789518027.559626:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e740dd9cd40 from 1 10000000:01000000:1.0:1789518027.559630:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1789518027.559807:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522579584:0@lo:400: 00010000:00010000:1.0:1789518027.559876:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.559886:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.559896:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.559912:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522579840:0@lo:101: 00000100:00100000:1.0:1789518027.559944:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.560025:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.561337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579456 00000100:00100000:2.0:1789518027.561350:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579456 00000100:00100000:2.0:1789518027.561406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579200 00000100:00100000:2.0:1789518027.561410:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579200 00000100:00100000:2.0:1789518027.561429:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518027.561438:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522579456:12345-0@lo:400: 00000100:00100000:2.0:1789518027.561552:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522579456:12345-0@lo:400: Request processed in 115us (7876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.561560:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518027.561577:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518027.561584:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522579200:12345-0@lo:400: 00000100:00100000:2.0:1789518027.561621:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522579200:12345-0@lo:400: Request processed in 38us (6833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.561627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789518027.561685:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7301965180 x1876445522579200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518027.561699:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522579200:0@lo:400: 00010000:00080000:1.0:1789518027.563166:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7301967800 x1876445522579456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518027.563183:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522579456:0@lo:400: 00000100:00100000:0.0:1789518027.564804:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579840 00000100:00100000:0.0:1789518027.564818:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579840 00010000:00010000:3.0:1789518027.565577:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000100:00100000:0.0:1789518027.565760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789518027.565775:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522579840:12345-0@lo:101: 00010000:00010000:0.0:1789518027.565795:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518027.565813:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313fd4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.565845:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.565858:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.565867:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030a00, rc 0) 00000100:00100000:0.0:1789518027.565972:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522579840:12345-0@lo:101: Request processed in 201us (6027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.565989:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789518027.566110:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522579840:0@lo:101: 00010000:00010000:2.0:1789518027.566129:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.566150:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.566238:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522579968:0@lo:501: 00000100:00100000:2.0:1789518027.566272:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:02000400:3.0:1789518027.566679:0:8446:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789518027.569628:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789518027.570276:0:8446:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00000100:00100000:2.0:1789518027.571544:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fdac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.571648:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522579968 00000100:00100000:1.0:1789518027.571661:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522579968 00000100:00100000:1.0:1789518027.571717:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789518027.571728:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522579968:12345-0@lo:501: 00000100:00100000:1.0:1789518027.571933:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522579968:12345-0@lo:501: Request processed in 206us (5659us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518027.571942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789518027.572030:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522579968:0@lo:501: 10000000:01000000:2.0:1789518027.572084:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789518027.572096:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.572108:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789518027.574550:0:8446:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789518027.574901:0:8446:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789518027.580845:0:8446:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789518027.582375:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789518027.582403:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518027.582410:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518027.582412:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789518027.582415:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518027.582420:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518027.582421:0:8446:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518027.582424:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518027.582426:0:8446:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518027.582449:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518027.582451:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518027.582453:0:8446:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789518027.582456:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789518027.588406:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789518027.588457:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789518027.588497:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.588512:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518027.588522:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7435dc1800 from 1 10000000:01000000:1.0:1789518027.588525:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518027.588564:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.588573:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.588585:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518027.588608:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580096:0@lo:101: 00000100:00100000:1.0:1789518027.588940:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.588984:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a487300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.589101:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580096 00000100:00100000:2.0:1789518027.589110:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580096 00000100:00100000:2.0:1789518027.589163:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789518027.589173:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:8420:x1876445522580096:12345-0@lo:101: 00010000:00010000:2.0:1789518027.589190:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518027.589205:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313fe2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.589229:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.589241:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.589263:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf400, rc 0) 00000100:00100000:2.0:1789518027.589318:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580096:12345-0@lo:101: Request processed in 146us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.589325:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789518027.589417:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580096:0@lo:101: 00010000:00010000:3.0:1789518027.589434:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518027.589444:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518027.589585:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580224:0@lo:501: 00000100:00100000:3.0:1789518027.589613:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518027.589645:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74395c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.589948:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580224 00000100:00100000:2.0:1789518027.589954:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580224 00000100:00100000:2.0:1789518027.589989:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789518027.589996:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580224:12345-0@lo:501: 00000100:00100000:2.0:1789518027.590093:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580224:12345-0@lo:501: Request processed in 96us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.590099:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789518027.590133:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580224:0@lo:501: 00000100:00100000:2.0:1789518027.590160:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580352:0@lo:503: 00000100:00100000:2.0:1789518027.590196:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.590209:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74052826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.590221:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580352 00000100:00100000:2.0:1789518027.590224:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580352 00000100:00100000:2.0:1789518027.590241:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789518027.590246:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580352:12345-0@lo:503: 00000100:00100000:2.0:1789518027.590315:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580352:12345-0@lo:503: Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.590322:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789518027.590358:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580352:0@lo:503: 00000040:00080000:2.0:1789518027.590909:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518027.590996:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580480:0@lo:502: 00000100:00100000:2.0:1789518027.591037:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.591057:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74052826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.591078:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580480 00000100:00100000:2.0:1789518027.591083:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580480 00000100:00100000:2.0:1789518027.591102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789518027.591108:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580480:12345-0@lo:502: 00000100:00100000:2.0:1789518027.591191:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580480:12345-0@lo:502: Request processed in 81us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.591198:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789518027.591243:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580480:0@lo:502: 00000040:00080000:2.0:1789518027.591490:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789518027.591515:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789518027.591535:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580608:0@lo:502: 00000100:00100000:2.0:1789518027.591568:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.591584:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74052826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.591597:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580608 00000100:00100000:2.0:1789518027.591601:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580608 00000100:00100000:2.0:1789518027.591620:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789518027.591626:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580608:12345-0@lo:502: 00000100:00100000:2.0:1789518027.592118:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580608:12345-0@lo:502: Request processed in 490us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.592127:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789518027.599357:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580608:0@lo:502: 00000040:00080000:3.0:1789518027.599519:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789518027.599536:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789518027.600515:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518027.600526:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518027.600529:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789518027.600535:0:8450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7435dc1800 00000020:00000080:3.0:1789518027.600538:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518027.600551:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518027.600554:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518027.600555:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789518027.600559:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789518027.600883:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789518027.600922:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518027.600946:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.600971:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518027.601023:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789518027.601026:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e7435dc1800 10000000:01000000:2.0:1789518027.601029:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e7435dc1800 10000000:01000000:2.0:1789518027.601033:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518027.601039:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7435dc1800 from 1 10000000:01000000:2.0:1789518027.601041:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518027.601080:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.601088:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.601099:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.601122:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580736:0@lo:101: 00000100:00100000:2.0:1789518027.601191:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.601493:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580736 00000100:00100000:1.0:1789518027.601504:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580736 00000100:00100000:1.0:1789518027.601558:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789518027.601568:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8420:x1876445522580736:12345-0@lo:101: 00010000:00010000:1.0:1789518027.601593:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518027.601609:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942313ff0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.601649:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.601667:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518027.601675:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0de00, rc 0) 00000100:00100000:1.0:1789518027.601711:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522580736:12345-0@lo:101: Request processed in 145us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.601728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789518027.603098:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.603136:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580736:0@lo:101: 00010000:00010000:2.0:1789518027.603161:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.603173:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.603321:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580864:0@lo:501: 00000100:00100000:2.0:1789518027.603375:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.603413:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518027.603436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580864 00000100:00100000:2.0:1789518027.603443:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580864 00000100:00100000:2.0:1789518027.603511:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789518027.603521:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522580864:12345-0@lo:501: 00000100:00100000:2.0:1789518027.603650:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522580864:12345-0@lo:501: Request processed in 131us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.603664:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789518027.603702:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580864:0@lo:501: 00000100:00100000:2.0:1789518027.604061:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580992:0@lo:503: 00000100:00100000:2.0:1789518027.604107:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.604132:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518027.604179:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522580992 00000100:00100000:0.0:1789518027.604185:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522580992 00000100:00100000:0.0:1789518027.604222:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518027.604239:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522580992:12345-0@lo:503: 00000100:00100000:0.0:1789518027.604326:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522580992:12345-0@lo:503: Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.604333:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789518027.604503:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522580992:0@lo:503: 00000040:00080000:2.0:1789518027.604984:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518027.605059:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522581120:0@lo:502: 00000100:00100000:2.0:1789518027.605097:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.605125:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518027.605184:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522581120 00000100:00100000:0.0:1789518027.605189:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522581120 00000100:00100000:0.0:1789518027.605241:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789518027.605249:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522581120:12345-0@lo:502: 00000100:00100000:0.0:1789518027.605338:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522581120:12345-0@lo:502: Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.605345:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789518027.605540:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522581120:0@lo:502: 00000040:00080000:2.0:1789518027.605927:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789518027.605956:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789518027.605969:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789518027.605986:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789518027.606011:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789518027.606026:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789518027.606041:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789518027.606056:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789518027.606085:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789518027.606102:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789518027.606115:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789518027.606128:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789518027.606138:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789518027.606151:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789518027.606164:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789518027.606177:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789518027.606190:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789518027.606202:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789518027.606213:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789518027.606225:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789518027.606321:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789518027.606337:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789518027.606351:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789518027.606364:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789518027.606401:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789518027.606416:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789518027.606427:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789518027.606437:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789518027.606448:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789518027.606460:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789518027.606518:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789518027.606531:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789518027.606541:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789518027.606554:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789518027.606566:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789518027.606578:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789518027.606590:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1789518027.606974:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522581248:0@lo:502: 00000100:00100000:2.0:1789518027.607046:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.607092:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518027.607372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522581248 00000100:00100000:1.0:1789518027.607392:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522581248 00000100:00100000:1.0:1789518027.607448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789518027.607459:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522581248:12345-0@lo:502: 00000100:00100000:1.0:1789518027.607611:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522581248:12345-0@lo:502: Request processed in 153us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.607618:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789518027.607870:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522581248:0@lo:502: 00000040:00080000:2.0:1789518027.607932:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789518027.607942:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789518027.608903:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789518027.608924:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e743b253380) 00000020:00000080:0.0:1789518027.608948:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1789518027.609052:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7435dc1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789518027.609057:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7435dc1800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789518027.609060:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7435dc1800 3 00010000:00080000:0.0:1789518027.609095:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e73020d3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789518027.611618:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1789518027.612195:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789518027.612252:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789518027.612266:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8d0fd67942314005 00000100:00080000:0.0:1789518027.612277:0:8451:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518027.612289:0:8451:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e73020d3000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518027.612329:0:8451:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e740480d880 x1876445522581376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518027.612360:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789518027.612609:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522581376:0@lo:38: 00000100:00100000:2.0:1789518027.612697:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.612910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522581376 00000100:00100000:0.0:1789518027.612920:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522581376 00000100:00100000:0.0:1789518027.612962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518027.612970:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522581376:12345-0@lo:38: 00010000:00080000:0.0:1789518027.613000:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1789518027.613998:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8d0fd6794231400c 00000004:00100000:0.0:1789518027.614021:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518027.614071:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8e73020d4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518027.614151:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876445522581376:12345-0@lo:38: Request processed in 1179us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.614161:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789518027.614301:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e740480d880 x1876445522581376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518027.614312:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518027.614320:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789518027.614328:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789518027.614333:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789518027.614336:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789518027.614343:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522581376:0@lo:38: 00000020:01000004:1.0:1789518027.617609:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789518027.619295:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e74217e8000) 00000020:00000080:1.0:1789518027.619333:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type lwp with refcount 2 00000020:01000004:1.0:1789518027.620063:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7435dc1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789518027.620071:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7435dc1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789518027.620075:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7435dc1800 3 00010000:00080000:1.0:1789518027.620111:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e740d7b2800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789518027.627295:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-7 is initialized 00000020:00000080:1.0:1789518027.627593:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789518027.627646:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789518027.627665:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8d0fd6794231401a 00000100:00080000:1.0:1789518027.627675:0:8451:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518027.627687:0:8451:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e740d7b2800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518027.627724:0:8451:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7301965880 x1876445522581504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518027.627750:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789518027.628983:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1876445522581504:0@lo:38: 00000100:00100000:3.0:1789518027.629060:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789518027.629519:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789518027.630004:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522581504 00000100:00100000:2.0:1789518027.630014:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522581504 00000100:00100000:2.0:1789518027.630061:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518027.630070:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1876445522581504:12345-0@lo:38: 00010000:00080000:2.0:1789518027.630102:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:2.0:1789518027.630141:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8d0fd67942314021 00000004:00100000:2.0:1789518027.630160:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789518027.630196:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8e7435e30000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518027.630279:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876445522581504:12345-0@lo:38: Request processed in 208us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.630299:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:2.0:1789518027.630323:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789518027.630353:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518027.630375:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.630400:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789518027.630453:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789518027.630456:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518027.630457:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518027.630459:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518027.630484:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518027.630486:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518027.630487:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518027.630489:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518027.630491:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518027.630492:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518027.630494:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518027.630498:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789518027.630500:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518027.630501:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518027.630502:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518027.630503:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518027.630504:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518027.630505:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518027.630507:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518027.630508:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518027.630509:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518027.630510:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518027.630511:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518027.630531:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789518027.630547:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522581632:0@lo:253: 00000100:00100000:2.0:1789518027.630588:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.630623:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522581632 00000100:00100000:2.0:1789518027.630627:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522581632 00000100:00100000:2.0:1789518027.630867:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789518027.630875:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:8420:x1876445522581632:12345-0@lo:253: 20000000:01000000:2.0:1789518027.630897:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789518027.630912:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789518027.631042:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3cc0 going to sleep for 11 seconds 00010000:00080000:3.0:1789518027.631996:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7301965880 x1876445522581504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518027.632011:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518027.632021:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789518027.632030:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789518027.632036:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789518027.632038:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e740d7b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518027.632045:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1876445522581504:0@lo:38: 20000000:01000000:3.0:1789518027.644031:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518027.644064:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789518027.644248:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789518027.644254:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789518027.644279:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644298:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e740165ce00/0x8d0fd67942313eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644306:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e74421c2e00/0x8d0fd67942313f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644314:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644357:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e74421c2e00/0x8d0fd67942313f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644371:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e74421c2e00/0x8d0fd67942313f09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.644399:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522581760:0@lo:104: 00000100:00100000:0.0:1789518027.644483:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518027.644534:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e740165ce00/0x8d0fd67942313eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644543:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e740165ce00/0x8d0fd67942313eed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518027.644565:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522581888:0@lo:104: 00000100:00100000:0.0:1789518027.644587:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518027.644606:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518027.644639:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522581760 00000100:00100000:0.0:1789518027.644648:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522581760 00000100:00100000:0.0:1789518027.644697:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522581888 00000100:00100000:0.0:1789518027.644700:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522581888 00000100:00100000:0.0:1789518027.644715:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518027.644724:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6529:x1876445522581760:12345-0@lo:104: 00010000:00010000:0.0:1789518027.644738:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644790:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518027.644803:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6529:x1876445522581760:12345-0@lo:104: Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.644810:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518027.644828:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518027.644834:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522581888:12345-0@lo:104: 00010000:00010000:0.0:1789518027.644841:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644873:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518027.644878:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522581888:12345-0@lo:104: Request processed in 45us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518027.644883:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789518027.644899:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518027.644905:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644919:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c2000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518027.644922:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644931:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518027.644938:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518027.644944:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518027.644977:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.644984:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518027.645006:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.645013:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c2000/0x8d0fd67942313f02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f09 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.645028:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518027.645031:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.645037:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166de00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518027.645039:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.645056:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518027.645062:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518027.645067:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518027.645082:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.645088:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518027.645102:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.645109:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740166de00/0x8d0fd67942313ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518027.645124:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.645125:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.645127:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518027.645133:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518027.645170:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522581760:0@lo:104: 00000100:00100000:0.0:1789518027.645180:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522581888:0@lo:104: 00010000:00010000:0.0:1789518027.645195:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.645672:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522582016:0@lo:103: 00000100:00100000:2.0:1789518027.645717:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.645774:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582016 00000100:00100000:2.0:1789518027.645780:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582016 00010000:00010000:2.0:1789518027.645802:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e74421c2e00/0x8d0fd67942313f09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.645828:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518027.645836:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3638:x1876445522582016:12345-0@lo:103: 00010000:00010000:2.0:1789518027.645850:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518027.645856:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e74421c2e00/0x8d0fd67942313f09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.645867:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e74421c2e00/0x8d0fd67942313f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.645881:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e74421c2e00/0x8d0fd67942313f09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313f02 expref: 19 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.645895:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518027.645927:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3638:x1876445522582016:12345-0@lo:103: Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.645934:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518027.645981:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522582016:0@lo:103: 00000100:00100000:0.0:1789518027.646560:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522582144:0@lo:103: 00000100:00100000:0.0:1789518027.646597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.647506:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582144 00000100:00100000:2.0:1789518027.647516:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582144 00010000:00010000:2.0:1789518027.647544:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e740165ce00/0x8d0fd67942313eed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518027.647573:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518027.647582:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3639:x1876445522582144:12345-0@lo:103: 00010000:00010000:2.0:1789518027.647595:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518027.647601:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e740165ce00/0x8d0fd67942313eed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647612:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e740165ce00/0x8d0fd67942313eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647643:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740165ce00/0x8d0fd67942313eed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313ee6 expref: 18 pid: 6507 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647664:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647674:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518027.647692:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003438936s 00010000:00010000:2.0:1789518027.647698:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647705:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647725:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647732:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647739:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518027.647744:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647753:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647771:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647782:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518027.647825:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:3639:x1876445522582144:12345-0@lo:103: Request processed in 244us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.647833:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518027.647889:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522582144:0@lo:103: 00010000:00010000:2.0:1789518027.647914:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647923:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518027.647930:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400031e00/0x8d0fd67942314028 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518027.648157:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:8420:x1876445522581632:12345-0@lo:253: Request processed in 17281us (17566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518027.648166:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789518027.650236:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8420:1876445522581632:0@lo:253: 10000000:01000000:0.0:1789518027.650257:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789518027.650261:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518027.650263:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518027.650265:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518027.650266:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518027.650267:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518027.650270:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518027.650271:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518027.650272:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518027.650274:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518027.650275:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518027.650276:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789518027.650292:0:8420:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789518027.659305:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789518027.659888:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789518027.660201:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789518027.660626:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789518027.661167:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789518027.661411:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789518027.663260:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789518027.682524:0:8420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789518027.682535:0:8420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789518027.682576:0:8420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518027.682710:0:8420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518027.682842:0:8420:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789518027.682864:0:8420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789518027.702083:0:8420:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518027.702259:0:8420:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789518027.769005:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518027.769033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522582272:0@lo:41: 00000100:00100000:2.0:1789518027.769123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518027.769198:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582272 00000100:00100000:2.0:1789518027.769207:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582272 00000100:00100000:2.0:1789518027.769249:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518027.769259:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522582272:12345-0@lo:41: 00000004:00000024:2.0:1789518027.769296:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789518027.769342:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522582272:12345-0@lo:41: Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518027.769350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518027.769407:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522582272:0@lo:41: 00000100:00100000:1.0:1789518027.771737:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518027.771765:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522582400:0@lo:41: 00000100:00100000:1.0:1789518027.771833:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518027.771879:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582400 00000100:00100000:1.0:1789518027.771887:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582400 00000100:00100000:1.0:1789518027.771931:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518027.771940:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522582400:12345-0@lo:41: 00000004:00000024:1.0:1789518027.771979:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789518027.772025:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522582400:12345-0@lo:41: Request processed in 86us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518027.772032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518027.772080:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522582400:0@lo:41: 00010000:00010000:1.0:1789518027.832941:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789518028.593890:0:8507:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789518028.594044:0:8507:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518028.853745:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518029.880511:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518030.902183:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518031.944980:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518032.885687:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518032.885722:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522582528:0@lo:41: 00000100:00100000:2.0:1789518032.885824:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518032.885919:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582528 00000100:00100000:2.0:1789518032.885928:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582528 00000100:00100000:2.0:1789518032.885982:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789518032.885991:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522582528:12345-0@lo:41: 00000004:00000024:2.0:1789518032.886044:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789518032.886287:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522582528:12345-0@lo:41: Request processed in 295us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518032.886295:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789518032.886356:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522582528:0@lo:41: 00000100:00080000:0.0:1789518032.887388:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518032.887396:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789518032.887400:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e7301977800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518032.887406:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 195 00000100:00080000:0.0:1789518032.887411:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789518032.887422:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e7301977800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518032.887446:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e740480ea00 x1876445522583168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518032.889034:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522583040:0@lo:400: 00000100:00100000:3.0:1789518032.889135:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518032.889188:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518032.889195:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522582912:0@lo:400: 00000100:00100000:3.0:1789518032.889224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518032.889289:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522583168:0@lo:8: 00000100:00100000:3.0:1789518032.889326:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518032.889389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583040 00000100:00100000:3.0:1789518032.889398:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583040 00000100:00100000:3.0:1789518032.889451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518032.889459:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522583040:12345-0@lo:400: 00000100:00100000:3.0:1789518032.889528:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522583040:12345-0@lo:400: Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518032.889535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518032.889560:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582912 00000100:00100000:3.0:1789518032.889579:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582912 00000100:00100000:3.0:1789518032.889603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518032.889608:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522582912:12345-0@lo:400: 00000100:00100000:3.0:1789518032.889636:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522582912:12345-0@lo:400: Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518032.889641:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518032.889677:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522582912:0@lo:400: 00010000:00080000:3.0:1789518032.889689:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480e680 x1876445522583040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518032.889699:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522583040:0@lo:400: 00000100:00100000:0.0:1789518032.890231:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522582784:0@lo:400: 00000100:00100000:0.0:1789518032.890768:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518032.891173:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522582656:0@lo:400: 00000100:00100000:2.0:1789518032.891215:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518032.891265:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522583296:0@lo:400: 00000100:00100000:2.0:1789518032.891288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518032.891787:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582784 00000100:00100000:3.0:1789518032.891797:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582784 00000100:00100000:0.0:1789518032.892216:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522583424:0@lo:400: 00000100:00100000:0.0:1789518032.892371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518032.892783:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583168 00000100:00100000:0.0:1789518032.892791:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583168 00000100:00100000:0.0:1789518032.892833:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518032.892842:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1876445522583168:12345-0@lo:8: 00010000:00080000:0.0:1789518032.892907:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789518032.892944:0:8429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd6794231402f 00002000:00100000:0.0:1789518032.892996:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e73020d0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789518032.893001:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789518032.893005:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789518032.893095:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789518032.893424:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518032.893484:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e73020d7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518032.893566:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1876445522583168:12345-0@lo:8: Request processed in 723us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518032.893574:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518032.894924:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583296 00000100:00100000:2.0:1789518032.894936:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583296 00000100:00100000:2.0:1789518032.894983:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583424 00000100:00100000:2.0:1789518032.894986:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583424 00000100:00100000:2.0:1789518032.895006:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518032.895015:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522582784:12345-0@lo:400: 00000100:00100000:2.0:1789518032.895107:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522582784:12345-0@lo:400: Request processed in 94us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518032.895114:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518032.895132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518032.895138:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522583296:12345-0@lo:400: 00000100:00100000:2.0:1789518032.895171:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522583296:12345-0@lo:400: Request processed in 34us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518032.895177:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518032.895187:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518032.895192:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522583424:12345-0@lo:400: 00000100:00100000:2.0:1789518032.895218:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522583424:12345-0@lo:400: Request processed in 27us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518032.895233:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789518032.895292:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480ed80 x1876445522582784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518032.895308:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522582784:0@lo:400: 00010000:00080000:2.0:1789518032.895327:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480d880 x1876445522583424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518032.895346:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522583424:0@lo:400: 00010000:00080000:2.0:1789518032.895402:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480f480 x1876445522583296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518032.895413:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522583296:0@lo:400: 00010000:00080000:2.0:1789518032.895532:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480ea00 x1876445522583168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518032.895541:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518032.895550:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789518032.895559:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789518032.895565:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789518032.895568:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7301977800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789518032.895585:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789518032.895592:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522583168:0@lo:8: 00000100:00100000:2.0:1789518032.895611:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518032.895624:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522583552:0@lo:41: 00000100:00100000:2.0:1789518032.895665:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518032.896033:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518032.896038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518032.896048:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583552 00000100:00100000:3.0:1789518032.896061:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583552 00000100:00100000:3.0:1789518032.896091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518032.896098:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522583552:12345-0@lo:41: 00000004:00000024:3.0:1789518032.896125:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789518032.896169:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522583552:12345-0@lo:41: Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518032.896175:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518032.896206:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522583552:0@lo:41: 00000004:00080000:1.0:1789518032.896741:0:8444:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789518032.896801:0:8444:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200682336334ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789518032.896813:0:8444:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789518032.904693:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522582656 00000100:00100000:0.0:1789518032.904715:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522582656 00000100:00100000:0.0:1789518032.905353:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518032.905370:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3639:x1876445522582656:12345-0@lo:400: 00000100:00100000:0.0:1789518032.905643:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3639:x1876445522582656:12345-0@lo:400: Request processed in 279us (14426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518032.905652:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518032.905762:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522582656:0@lo:400: 00000004:00080000:1.0:1789518032.912758:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789518032.913303:0:8445:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789518032.913343:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522583808:0@lo:7: 00000100:00100000:1.0:1789518032.913418:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518032.913944:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7404deb840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518032.913968:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518032.913985:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522583680:0@lo:13: 00000100:00100000:3.0:1789518032.914192:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583808 00000100:00100000:3.0:1789518032.914208:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583808 00000100:00100000:1.0:1789518032.914222:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518032.914323:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518032.914365:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8445:x1876445522583808:12345-0@lo:7: 00000100:00100000:2.0:1789518032.915432:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583680 00000100:00100000:2.0:1789518032.915447:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583680 00000100:00100000:2.0:1789518032.915503:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518032.915511:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522583680:12345-0@lo:13: 00002000:00000024:2.0:1789518032.915531:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:2.0:1789518032.915615:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522583680:12345-0@lo:13: Request processed in 106us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518032.915622:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789518032.915671:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301966680 x1876445522583680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518032.915695:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522583680:0@lo:13: 00000100:00080000:2.0:1789518032.917183:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518032.952645:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789518032.957998:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789518032.958010:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789518032.958142:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8445:x1876445522583808:12345-0@lo:7: Request processed in 43777us (44718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518032.958153:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789518032.958583:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301967b80 x1876445522583808/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518048 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518032.958603:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522583808:0@lo:7: 00000004:00080000:2.0:1789518032.958621:0:8445:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789518032.958666:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522583936:0@lo:5: 00000100:00100000:2.0:1789518032.958704:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518032.958752:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:0.0:1789518032.959618:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522583936 00000100:00100000:0.0:1789518032.959630:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522583936 00000100:00100000:0.0:1789518032.959696:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518032.959708:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8445:x1876445522583936:12345-0@lo:5: 00002000:00080000:0.0:1789518032.959753:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789518032.959758:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1789518032.965262:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789518032.965350:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789518032.965650:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8445:x1876445522583936:12345-0@lo:5: Request processed in 5936us (6936us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789518032.965670:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789518032.965796:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e743f83ca80 x1876445522583936/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518048 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518032.965810:0:8445:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789518032.965817:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522583936:0@lo:5: 00000004:00080000:3.0:1789518032.965834:0:8445:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789518032.965904:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522584064:0@lo:700: 00000100:00100000:3.0:1789518032.965944:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518032.965986:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518032.966389:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584064 00000100:00100000:0.0:1789518032.966403:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584064 00000100:00100000:0.0:1789518032.966489:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518032.966500:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8445:x1876445522584064:12345-0@lo:700: 00000100:00100000:0.0:1789518032.966576:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1876445522584192:0@lo:700: 00000100:00100000:0.0:1789518032.966643:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518032.966676:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518032.966989:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584192 00000100:00100000:2.0:1789518032.967000:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584192 00000100:00100000:2.0:1789518032.967069:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518032.967078:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1876445522584192:12345-0@lo:700: 40000000:02000000:3.0:1789518032.988758:0:6520:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789518033.010271:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1876445522584192:12345-0@lo:700: Request processed in 43172us (43606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518033.010290:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789518033.016724:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480dc00 x1876445522584192/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789518048 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518033.016748:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1876445522584192:0@lo:700: 40000000:02000000:3.0:1789518033.016767:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1789518033.057198:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8445:x1876445522584064:12345-0@lo:700: Request processed in 90692us (91245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518033.057220:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789518033.057277:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e74317c1180 x1876445522584064/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789518048 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518033.057294:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522584064:0@lo:700: 00000004:02000040:2.0:1789518033.066896:0:8445:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000400 00000100:00100000:2.0:1789518033.077416:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522584320:0@lo:5: 00000100:00100000:2.0:1789518033.077528:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518033.077598:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f256c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518033.078162:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584320 00000100:00100000:0.0:1789518033.078175:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584320 00000100:00100000:0.0:1789518033.080771:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518033.080817:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8445:x1876445522584320:12345-0@lo:5: 00002000:00080000:0.0:1789518033.095456:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789518033.095506:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:3.0:1789518033.097406:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e743f83df80 x1876445522584320/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518049 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518033.097434:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8445:1876445522584320:0@lo:5: 00000004:00080000:3.0:1789518033.097453:0:8445:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789518033.115831:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8445:x1876445522584320:12345-0@lo:5: Request processed in 16528us (19796us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789518033.115853:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789518033.977648:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518034.933561:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789518034.933571:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e74044cd800 from 30 10000000:01000000:0.0:1789518034.933576:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518034.933639:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.933651:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.933695:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518034.933724:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522584448:0@lo:101: 00000100:00100000:0.0:1789518034.933812:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.933880:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518034.934206:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584448 00000100:00100000:1.0:1789518034.934217:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584448 00000100:00100000:1.0:1789518034.934286:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789518034.934297:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522584448:12345-0@lo:101: 00010000:00010000:1.0:1789518034.934322:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518034.934338:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314036 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518034.934367:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314036 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518034.934381:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314036 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518034.934391:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0cc00, rc 0) 00000100:00100000:1.0:1789518034.934437:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522584448:12345-0@lo:101: Request processed in 142us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518034.934444:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518034.934627:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522584448:0@lo:101: 00010000:00010000:0.0:1789518034.934643:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.934664:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518034.934731:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522584576:0@lo:501: 00000100:00100000:0.0:1789518034.934757:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.934786:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518034.935331:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584576 00000100:00100000:1.0:1789518034.935350:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584576 00000100:00100000:1.0:1789518034.935391:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789518034.935400:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522584576:12345-0@lo:501: 00000100:00100000:1.0:1789518034.935577:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522584576:12345-0@lo:501: Request processed in 178us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518034.935583:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518034.935684:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522584576:0@lo:501: 00000100:00100000:0.0:1789518034.935722:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522584704:0@lo:503: 00000100:00100000:0.0:1789518034.935768:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.935795:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518034.936402:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584704 00000100:00100000:1.0:1789518034.936410:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584704 00000100:00100000:1.0:1789518034.936455:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789518034.936486:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522584704:12345-0@lo:503: 00000100:00100000:1.0:1789518034.936595:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522584704:12345-0@lo:503: Request processed in 132us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518034.936602:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789518034.936841:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522584704:0@lo:503: 00000100:00100000:0.0:1789518034.951973:0:8769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8769:1876445522584832:0@lo:502: 00000100:00100000:0.0:1789518034.952078:0:8769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.952137:0:8769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518034.952392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584832 00000100:00100000:3.0:1789518034.952402:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584832 00000100:00100000:3.0:1789518034.952457:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789518034.952488:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8769:x1876445522584832:12345-0@lo:502: 00000100:00100000:3.0:1789518034.952636:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8769:x1876445522584832:12345-0@lo:502: Request processed in 151us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518034.952651:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789518034.952826:0:8769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8769:1876445522584832:0@lo:502: 00000100:00100000:0.0:1789518034.952885:0:8769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8769:1876445522584960:0@lo:502: 00000100:00100000:0.0:1789518034.952919:0:8769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.952962:0:8769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518034.953347:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522584960 00000100:00100000:3.0:1789518034.953354:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522584960 00000100:00100000:3.0:1789518034.953394:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518034.953402:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8769:x1876445522584960:12345-0@lo:502: 00000100:00100000:3.0:1789518034.953514:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:8769:x1876445522584960:12345-0@lo:502: Request processed in 113us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518034.953521:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518034.954162:0:8769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8769:1876445522584960:0@lo:502: 00000040:00080000:0.0:1789518034.954193:0:8769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789518034.956490:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789518034.956536:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518034.956551:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518034.956565:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518034.956577:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789518034.956580:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e74044cd800 from 5 10000000:01000000:2.0:1789518034.956584:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789518034.956634:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518034.956643:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518034.956683:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518034.956711:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585088:0@lo:101: 00000100:00100000:2.0:1789518034.956801:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518034.956845:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518034.962885:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585088 00000100:00100000:0.0:1789518034.962909:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585088 00000100:00100000:0.0:1789518034.962996:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789518034.963008:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522585088:12345-0@lo:101: 00010000:00010000:0.0:1789518034.963029:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518034.963054:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314044 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.963089:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314044 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.963102:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314044 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.963112:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030c00, rc 0) 00000100:00100000:0.0:1789518034.963221:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522585088:12345-0@lo:101: Request processed in 215us (6421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518034.963228:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789518034.963319:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585088:0@lo:101: 00010000:00010000:0.0:1789518034.963343:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.963374:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518034.963483:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585216:0@lo:256: 00000100:00100000:0.0:1789518034.963527:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.963560:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518034.963581:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585216 00000100:00100000:0.0:1789518034.963585:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585216 00000100:00100000:0.0:1789518034.963608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518034.963614:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522585216:12345-0@lo:256: 20000000:01000000:0.0:1789518034.963628:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518034.963648:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518034.963651:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789518034.963737:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522585216:12345-0@lo:256: Request processed in 122us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518034.963744:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518034.963770:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585216:0@lo:256: 10000000:01000000:0.0:1789518034.963813:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518034.963821:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.963829:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518034.963838:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789518034.963842:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789518034.963845:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789518034.963868:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.963876:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.963884:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518034.963895:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585344:0@lo:101: 00000100:00100000:0.0:1789518034.963921:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.963934:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518034.963946:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585344 00000100:00100000:0.0:1789518034.963949:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585344 00000100:00100000:0.0:1789518034.963967:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789518034.963972:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522585344:12345-0@lo:101: 00010000:00010000:0.0:1789518034.963979:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518034.963987:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314052 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.964001:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314052 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.964009:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314052 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.964017:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:0.0:1789518034.964042:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522585344:12345-0@lo:101: Request processed in 70us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518034.964047:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789518034.964082:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585344:0@lo:101: 00010000:00010000:0.0:1789518034.964092:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518034.964099:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518034.964152:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585472:0@lo:501: 00000100:00100000:0.0:1789518034.964175:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.964186:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518034.964197:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585472 00000100:00100000:0.0:1789518034.964200:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585472 00000100:00100000:0.0:1789518034.964216:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789518034.964222:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522585472:12345-0@lo:501: 00000100:00100000:0.0:1789518034.964352:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522585472:12345-0@lo:501: Request processed in 129us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518034.964359:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789518034.964386:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585472:0@lo:501: 00000100:00100000:0.0:1789518034.964412:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585600:0@lo:503: 00000100:00100000:0.0:1789518034.964455:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.964489:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409ec8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518034.964500:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585600 00000100:00100000:0.0:1789518034.964503:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585600 00000100:00100000:0.0:1789518034.964522:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789518034.964527:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522585600:12345-0@lo:503: 00000100:00100000:0.0:1789518034.964605:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522585600:12345-0@lo:503: Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518034.964621:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789518034.964658:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522585600:0@lo:503: 00000100:00100000:0.0:1789518034.964874:0:8773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8773:1876445522585728:0@lo:502: 00000100:00100000:0.0:1789518034.964905:0:8773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518034.964922:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585728 00000100:00100000:0.0:1789518034.964925:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585728 00000100:00100000:0.0:1789518034.964944:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789518034.964949:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:8773:x1876445522585728:12345-0@lo:502: 00000100:00100000:0.0:1789518034.965015:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:8773:x1876445522585728:12345-0@lo:502: Request processed in 66us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518034.965022:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789518034.965046:0:8773:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409ec8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518034.965056:0:8773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8773:1876445522585728:0@lo:502: 00000020:01000000:0.0:1789518034.965075:0:8773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518034.965083:0:8773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789518034.965090:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518034.965093:0:8773:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789518034.965100:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789518034.965105:0:8773:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:0.0:1789518034.965126:0:8773:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789518034.965129:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518034.965145:0:8773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e743b254d40) 00000020:00000080:0.0:1789518034.965180:0:8773:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789518034.965186:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789518034.965271:0:8773:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789518034.965279:0:8773:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789518034.965292:0:8773:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942314067 00010000:00080000:0.0:1789518034.965337:0:8773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e73021fa800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789518034.965613:0:8773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-8 is initialized 00010000:00010000:3.0:1789518034.999990:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789518035.002404:0:8773:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789518035.002439:0:8773:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789518035.002749:0:8773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518035.003030:0:8773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518035.003125:0:8773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789518035.003217:0:8773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789518035.018417:0:8776:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518035.018426:0:8776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789518035.035535:0:8773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789518035.035554:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789518035.035613:0:8773:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789518035.035642:0:8773:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd6794231406e 00000100:00080000:0.0:1789518035.035655:0:8773:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518035.035668:0:8773:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e73021fa800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518035.035714:0:8773:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e740480ea00 x1876445522585856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518035.053075:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522585856:0@lo:8: 00000100:00100000:2.0:1789518035.053190:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789518035.053415:0:8773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789518035.053562:0:8773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518035.053571:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518035.053573:0:8773:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789518035.053578:0:8773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518035.053583:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518035.053584:0:8773:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789518035.053588:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789518035.053590:0:8773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789518035.053634:0:8773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8773:1876445522585984:0@lo:502: 00000100:00100000:2.0:1789518035.053694:0:8773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.053709:0:8773:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.054150:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585856 00000100:00100000:0.0:1789518035.054161:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585856 00000100:00100000:0.0:1789518035.054204:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518035.054213:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522585856:12345-0@lo:8: 00010000:00080000:0.0:1789518035.054258:0:8428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1789518035.054296:0:8428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd67942314075 00002000:00100000:0.0:1789518035.054320:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e73021fb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789518035.054325:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789518035.054328:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789518035.054429:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789518035.054459:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8e73021fb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518035.054549:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876445522585856:12345-0@lo:8: Request processed in 335us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.054556:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518035.054583:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522585984 00000100:00100000:0.0:1789518035.054596:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522585984 00000100:00100000:0.0:1789518035.054625:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789518035.054631:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:8773:x1876445522585984:12345-0@lo:502: 00000100:00100000:0.0:1789518035.054745:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:8773:x1876445522585984:12345-0@lo:502: Request processed in 114us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.054752:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789518035.054822:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480ea00 x1876445522585856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518035.054834:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518035.054842:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789518035.054850:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789518035.054857:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789518035.054860:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73021fa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789518035.054874:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789518035.054880:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522585856:0@lo:8: 00000004:00080000:0.0:1789518035.054910:0:8776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789518035.054990:0:8776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 202840525482ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789518035.054997:0:8776:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789518035.056358:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522586112:0@lo:400: 00000100:00100000:2.0:1789518035.056440:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.056507:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522586624:0@lo:400: 00000100:00100000:2.0:1789518035.056534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.056562:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789518035.056569:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522586240:0@lo:400: 00000100:00100000:2.0:1789518035.056595:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.056626:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522586752:0@lo:400: 00000100:00100000:2.0:1789518035.056647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.056681:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522586368:0@lo:400: 00000100:00100000:2.0:1789518035.056705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.056725:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522586880:0@lo:400: 00000100:00100000:2.0:1789518035.056743:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.056755:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518035.056762:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522586496:0@lo:400: 00000100:00100000:2.0:1789518035.056784:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518035.056819:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522586112 00000100:00100000:2.0:1789518035.056827:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522586112 00000100:00100000:2.0:1789518035.056866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522586752 00000100:00100000:2.0:1789518035.056870:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522586752 00000100:00100000:2.0:1789518035.056894:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522586368 00000100:00100000:2.0:1789518035.056896:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522586368 00000100:00100000:2.0:1789518035.056906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522586880 00000100:00100000:2.0:1789518035.056909:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522586880 00000100:00100000:2.0:1789518035.056925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518035.056932:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522586112:12345-0@lo:400: 00000100:00100000:1.0:1789518035.057372:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522586624 00000100:00100000:1.0:1789518035.057379:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522586624 00000100:00100000:1.0:1789518035.057417:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518035.057425:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522586624:12345-0@lo:400: 00000100:00100000:1.0:1789518035.057512:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522586624:12345-0@lo:400: Request processed in 88us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518035.057519:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518035.058439:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518035.058455:0:6514:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789518035.058711:0:8777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522587008:0@lo:700: 00000100:00100000:0.0:1789518035.058765:0:8777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.058819:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587008 00000100:00100000:0.0:1789518035.058827:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587008 00000100:00100000:0.0:1789518035.058868:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518035.058876:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8777:x1876445522587008:12345-0@lo:700: 00000100:00100000:2.0:1789518035.062238:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522586112:12345-0@lo:400: Request processed in 5299us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.065958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518035.066320:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518035.066339:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522586752:12345-0@lo:400: 00000100:00100000:2.0:1789518035.066454:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522586752:12345-0@lo:400: Request processed in 124us (9805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.066485:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518035.066503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518035.066522:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522586368:12345-0@lo:400: 00000100:00100000:2.0:1789518035.066563:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522586368:12345-0@lo:400: Request processed in 43us (9858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.066569:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518035.066581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518035.066589:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522586880:12345-0@lo:400: 00000100:00100000:2.0:1789518035.066619:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522586880:12345-0@lo:400: Request processed in 32us (9875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.066625:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518035.066651:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522586240 00000100:00100000:2.0:1789518035.066662:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522586240 00000100:00100000:2.0:1789518035.066696:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522586496 00000100:00100000:2.0:1789518035.066699:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522586496 00000100:00100000:2.0:1789518035.066713:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518035.066719:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522586240:12345-0@lo:400: 00000100:00100000:2.0:1789518035.066749:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522586240:12345-0@lo:400: Request processed in 30us (10154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.066755:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518035.066764:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518035.066769:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522586496:12345-0@lo:400: 00000100:00100000:2.0:1789518035.066790:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522586496:12345-0@lo:400: Request processed in 22us (10006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.066796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789518035.066822:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518035.066829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518035.066831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518035.066871:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522586496:0@lo:400: 00010000:00080000:2.0:1789518035.066898:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301964000 x1876445522586368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518035.066909:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522586368:0@lo:400: 00010000:00080000:2.0:1789518035.066921:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965180 x1876445522586880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518035.066929:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522586880:0@lo:400: 00000100:00100000:2.0:1789518035.067001:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522586240:0@lo:400: 00010000:00080000:2.0:1789518035.067022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301966300 x1876445522586752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518035.067031:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522586752:0@lo:400: 00010000:00080000:2.0:1789518035.067044:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301967b80 x1876445522586112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518035.067052:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522586112:0@lo:400: 00010000:00080000:2.0:1789518035.067064:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301967800 x1876445522586624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518035.067073:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522586624:0@lo:400: 00000100:00100000:2.0:1789518035.067105:0:8773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8773:1876445522585984:0@lo:502: 00000020:01000000:2.0:1789518035.067146:0:8773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518035.067154:0:8773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518035.067157:0:8773:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789518035.067165:0:8773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:0.0:1789518035.071125:0:8777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a0c0 going to sleep for 11 seconds 00000020:01000000:1.0:1789518035.074319:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789518035.074370:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789518035.074384:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518035.074418:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518035.074507:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789518035.074510:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7439644800 from 30 10000000:01000000:1.0:1789518035.074513:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518035.074555:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518035.074562:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518035.074572:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518035.074597:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587136:0@lo:101: 00000100:00100000:1.0:1789518035.074682:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518035.074728:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518035.075405:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587136 00000100:00100000:2.0:1789518035.075421:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587136 00000100:00100000:2.0:1789518035.075527:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789518035.075539:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522587136:12345-0@lo:101: 00010000:00010000:2.0:1789518035.075559:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518035.075579:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231407c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518035.075615:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231407c expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518035.075628:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231407c expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518035.075639:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcec00, rc 0) 00000100:00100000:2.0:1789518035.075718:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522587136:12345-0@lo:101: Request processed in 181us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.075727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789518035.075748:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587136:0@lo:101: 00010000:00010000:1.0:1789518035.075775:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518035.076269:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518035.076359:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587264:0@lo:501: 00000100:00100000:1.0:1789518035.076420:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789518035.076443:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789518035.076509:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.076792:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587264 00000100:00100000:0.0:1789518035.076807:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587264 00000100:00100000:0.0:1789518035.076854:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789518035.076864:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522587264:12345-0@lo:501: 00000100:00100000:0.0:1789518035.079566:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522587264:12345-0@lo:501: Request processed in 2696us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.079580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789518035.079714:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587264:0@lo:501: 00000100:00100000:0.0:1789518035.080158:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587392:0@lo:503: 00000100:00100000:0.0:1789518035.080216:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.080253:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518035.080453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587392 00000100:00100000:2.0:1789518035.080531:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587392 00000100:00100000:2.0:1789518035.080576:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789518035.080586:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522587392:12345-0@lo:503: 00000100:00100000:2.0:1789518035.080718:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522587392:12345-0@lo:503: Request processed in 133us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.080725:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789518035.080974:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587392:0@lo:503: 00000100:00100000:0.0:1789518035.081728:0:8782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8782:1876445522587520:0@lo:502: 00000100:00100000:0.0:1789518035.081782:0:8782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.081812:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587520 00000100:00100000:0.0:1789518035.081818:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587520 00000100:00100000:0.0:1789518035.081851:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789518035.081858:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:8782:x1876445522587520:12345-0@lo:502: 00000100:00100000:0.0:1789518035.081960:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:8782:x1876445522587520:12345-0@lo:502: Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.081968:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789518035.082004:0:8782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417ce180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.082020:0:8782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8782:1876445522587520:0@lo:502: 00000100:00100000:0.0:1789518035.082062:0:8782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8782:1876445522587648:0@lo:502: 00000100:00100000:0.0:1789518035.082095:0:8782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.082112:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587648 00000100:00100000:0.0:1789518035.082122:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587648 00000100:00100000:0.0:1789518035.082137:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518035.082143:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:8782:x1876445522587648:12345-0@lo:502: 00000100:00100000:0.0:1789518035.082195:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:8782:x1876445522587648:12345-0@lo:502: Request processed in 52us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.082202:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518035.082226:0:8782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.082236:0:8782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:8782:1876445522587648:0@lo:502: 00000040:00080000:0.0:1789518035.082265:0:8782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789518035.082332:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789518035.082356:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518035.082366:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.082379:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518035.082390:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789518035.082393:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7439644800 from 5 10000000:01000000:0.0:1789518035.082397:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518035.082424:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.082433:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.082443:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518035.082454:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587776:0@lo:101: 00000100:00100000:0.0:1789518035.082510:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.082523:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.082540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587776 00000100:00100000:0.0:1789518035.082544:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587776 00000100:00100000:0.0:1789518035.082560:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789518035.082565:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522587776:12345-0@lo:101: 00010000:00010000:0.0:1789518035.082573:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518035.082585:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231408a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.082607:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231408a expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.082618:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231408a expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.082627:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030e00, rc 0) 00000100:00100000:0.0:1789518035.082652:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522587776:12345-0@lo:101: Request processed in 86us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.082658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789518035.082685:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587776:0@lo:101: 00010000:00010000:0.0:1789518035.082698:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.082707:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518035.082745:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587904:0@lo:256: 00000100:00100000:0.0:1789518035.082781:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.082793:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.082837:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522587904 00000100:00100000:0.0:1789518035.082841:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522587904 00000100:00100000:0.0:1789518035.082857:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518035.082863:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522587904:12345-0@lo:256: 20000000:01000000:0.0:1789518035.082876:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518035.082895:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518035.082899:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789518035.082975:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522587904:12345-0@lo:256: Request processed in 111us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.082982:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518035.083040:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522587904:0@lo:256: 10000000:01000000:0.0:1789518035.083126:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518035.083132:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518035.083140:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789518035.088535:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1789518035.088551:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1789518035.088765:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8777:x1876445522587008:12345-0@lo:700: Request processed in 29884us (29993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518035.088780:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789518035.089163:0:8777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480ea00 x1876445522587008/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789518051 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518035.089182:0:8777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522587008:0@lo:700: 00000004:00080000:1.0:1789518035.133226:0:8777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000401:0x1:0x0] 00000100:00100000:1.0:1789518035.133288:0:8777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522588160:0@lo:7: 00000100:00100000:1.0:1789518035.133388:0:8777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518035.133446:0:8777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518035.133714:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522588032:0@lo:13: 00000100:00100000:3.0:1789518035.133756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518035.133814:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588032 00000100:00100000:3.0:1789518035.133824:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588032 00000100:00100000:3.0:1789518035.133883:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518035.133892:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522588032:12345-0@lo:13: 00002000:00000024:3.0:1789518035.133922:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1789518035.133974:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522588032:12345-0@lo:13: Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518035.133981:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789518035.134041:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301964e00 x1876445522588032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518035.134061:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522588032:0@lo:13: 00000100:00100000:0.0:1789518035.134630:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588160 00000100:00100000:0.0:1789518035.134637:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588160 00000100:00100000:0.0:1789518035.134697:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518035.134705:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8777:x1876445522588160:12345-0@lo:7: 00002000:00080000:0.0:1789518035.145132:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789518035.145144:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x1:0x0] 00000100:00100000:0.0:1789518035.145273:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8777:x1876445522588160:12345-0@lo:7: Request processed in 10563us (11879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.145284:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789518035.145366:0:8777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965f80 x1876445522588160/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518051 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518035.145383:0:8777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522588160:0@lo:7: 00000004:00080000:0.0:1789518035.145400:0:8777:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000401:0x1:0x0] 00000100:00100000:0.0:1789518035.145449:0:8777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522588288:0@lo:5: 00000100:00100000:0.0:1789518035.145511:0:8777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.145537:0:8777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417ce180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.145560:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588288 00000100:00100000:0.0:1789518035.145567:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588288 00000100:00100000:0.0:1789518035.145612:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518035.145620:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8777:x1876445522588288:12345-0@lo:5: 00002000:00080000:0.0:1789518035.145648:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789518035.145680:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8777:x1876445522588288:12345-0@lo:5: Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518035.145686:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789518035.145713:0:8777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480ea00 x1876445522588288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518051 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518035.145723:0:8777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522588288:0@lo:5: 00000004:00080000:0.0:1789518035.145732:0:8777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000401:0x1:0x0] from OST, last_created [0x280000401:0x1:0x0]last_used is [0x280000401:0x1:0x0] 00000100:00100000:0.0:1789518035.145763:0:8777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522588416:0@lo:5: 00000100:00100000:0.0:1789518035.145784:0:8777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.145798:0:8777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417ce180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518035.145808:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588416 00000100:00100000:0.0:1789518035.145811:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588416 00000100:00100000:0.0:1789518035.145830:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518035.145835:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8777:x1876445522588416:12345-0@lo:5: 00002000:00080000:0.0:1789518035.145855:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789518035.155328:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8777:x1876445522588416:12345-0@lo:5: Request processed in 9471us (9521us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789518035.155345:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789518035.155707:0:8777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480ea00 x1876445522588416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518051 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518035.155728:0:8777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8777:1876445522588416:0@lo:5: 00000004:00080000:1.0:1789518035.155747:0:8777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1789518035.160575:0:8777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8777:1876445522588544:0@lo:900: 00000100:00100000:0.0:1789518035.160689:0:8777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518035.160750:0:8777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417ce180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518035.163653:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588544 00000100:00100000:3.0:1789518035.163675:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588544 00000100:00100000:3.0:1789518035.163771:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518035.163783:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8777:x1876445522588544:12345-0@lo:900: 00000100:00100000:3.0:1789518035.163921:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8777:x1876445522588544:12345-0@lo:900: Request processed in 140us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518035.163929:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789518035.164739:0:8777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e740480dc00 x1876445522588544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789518051 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518035.164759:0:8777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8777:1876445522588544:0@lo:900: 00000001:02000400:1.0:1789518035.406226:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789518036.023564:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518037.046378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789518037.094919:0:8856:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789518037.095146:0:8856:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789518038.006088:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522588672:0@lo:41: 00000100:00100000:2.0:1789518038.006212:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518038.006568:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522588928:0@lo:41: 00000100:00100000:2.0:1789518038.006602:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518038.006637:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588672 00000100:00100000:2.0:1789518038.006646:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588672 00000100:00100000:2.0:1789518038.006691:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588928 00000100:00100000:2.0:1789518038.006694:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588928 00000100:00100000:2.0:1789518038.006710:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518038.006718:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522588672:12345-0@lo:41: 00000004:00000024:2.0:1789518038.006773:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789518038.006830:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522588672:12345-0@lo:41: Request processed in 110us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518038.006837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518038.006855:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518038.006861:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522588928:12345-0@lo:41: 00000004:00000024:2.0:1789518038.006878:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789518038.006917:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522588928:12345-0@lo:41: Request processed in 57us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518038.006923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518038.006972:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522588928:0@lo:41: 00000100:00100000:2.0:1789518038.007004:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522588672:0@lo:41: 00000100:00100000:2.0:1789518038.007015:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518038.007021:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522588800:0@lo:13: 00000100:00100000:2.0:1789518038.007048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518038.007537:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522588800 00000100:00100000:3.0:1789518038.007544:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522588800 00000100:00100000:3.0:1789518038.007599:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518038.007607:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522588800:12345-0@lo:13: 00002000:00000024:3.0:1789518038.007628:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518038.007671:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522588800:12345-0@lo:13: Request processed in 65us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518038.007677:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789518038.007709:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e743f83c700 x1876445522588800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518038.007720:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789518038.007748:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522588800:0@lo:13: 00000100:00080000:1.0:1789518038.007844:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518038.073691:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789518038.448960:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1789518039.094380:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518040.054063:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522589312:0@lo:400: 00000100:00100000:1.0:1789518040.054192:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522589184:0@lo:400: 00000100:00100000:0.0:1789518040.054314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522589056:0@lo:400: 00000100:00100000:2.0:1789518040.054373:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522589440:0@lo:400: 00000100:00100000:1.0:1789518040.054745:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518040.054811:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522589696:0@lo:400: 00000100:00100000:1.0:1789518040.054838:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518040.054891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589184 00000100:00100000:1.0:1789518040.054899:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589184 00000100:00100000:1.0:1789518040.054958:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518040.054967:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522589184:12345-0@lo:400: 00000100:00100000:1.0:1789518040.055029:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522589184:12345-0@lo:400: Request processed in 62us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518040.055036:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518040.055064:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589696 00000100:00100000:1.0:1789518040.055078:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589696 00000100:00100000:1.0:1789518040.056519:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518040.056544:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522589696:12345-0@lo:400: 00000100:00100000:1.0:1789518040.056630:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522589696:12345-0@lo:400: Request processed in 99us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518040.056637:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789518040.056676:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789518040.056720:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e74317c2680 x1876445522589184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518040.056738:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522589184:0@lo:400: 00010000:00080000:1.0:1789518040.056753:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435f23800 x1876445522589696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518040.056763:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522589696:0@lo:400: 00000100:00100000:3.0:1789518040.056906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518040.056961:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522589824:0@lo:400: 00000100:00100000:3.0:1789518040.056996:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518040.057339:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589312 00000100:00100000:1.0:1789518040.057347:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589312 00000100:00100000:1.0:1789518040.057399:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518040.057406:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522589312:12345-0@lo:400: 00000100:00100000:1.0:1789518040.057481:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522589312:12345-0@lo:400: Request processed in 76us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518040.057488:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518040.057520:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522589312:0@lo:400: 00000100:00100000:0.0:1789518040.057691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518040.057742:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522589568:0@lo:400: 00000100:00100000:0.0:1789518040.057782:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518040.057800:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522590080:0@lo:400: 00000100:00100000:0.0:1789518040.057822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518040.057877:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589824 00000100:00100000:0.0:1789518040.057882:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589824 00000100:00100000:0.0:1789518040.057921:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518040.057929:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522589824:12345-0@lo:400: 00000100:00100000:0.0:1789518040.057967:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522589824:12345-0@lo:400: Request processed in 40us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518040.057973:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518040.057993:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590080 00000100:00100000:0.0:1789518040.057996:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590080 00000100:00100000:0.0:1789518040.058020:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518040.058026:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522590080:12345-0@lo:400: 00000100:00100000:0.0:1789518040.058061:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522590080:12345-0@lo:400: Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518040.058067:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789518040.058097:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435f23480 x1876445522590080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518040.058107:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789518040.058134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522590080:0@lo:400: 00000100:00100000:3.0:1789518040.058506:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589568 00000100:00100000:3.0:1789518040.058512:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589568 00000100:00100000:3.0:1789518040.058542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518040.058549:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522589568:12345-0@lo:400: 00000100:00100000:3.0:1789518040.058608:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522589568:12345-0@lo:400: Request processed in 60us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518040.058628:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518040.058773:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522589568:0@lo:400: 00000100:00100000:1.0:1789518040.058857:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589056 00000100:00100000:1.0:1789518040.058863:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589056 00000100:00100000:1.0:1789518040.058903:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789518040.058911:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3638:x1876445522589056:12345-0@lo:400: 00000100:00100000:1.0:1789518040.058955:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3638:x1876445522589056:12345-0@lo:400: Request processed in 46us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518040.058968:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789518040.058999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518040.059004:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789518040.059033:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435f22a00 x1876445522589824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518040.059043:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522589824:0@lo:400: 00000100:00100000:3.0:1789518040.059877:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522589056:0@lo:400: 00000100:00100000:2.0:1789518040.060066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518040.060779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522589952:0@lo:400: 00000100:00100000:2.0:1789518040.060822:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518040.061028:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589440 00000100:00100000:1.0:1789518040.061038:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589440 00000100:00100000:1.0:1789518040.061170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522589952 00000100:00100000:1.0:1789518040.061174:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522589952 00000100:00080000:2.0:1789518040.061433:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518040.061561:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518040.061574:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522589440:12345-0@lo:400: 00000100:00100000:3.0:1789518040.061655:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522589440:12345-0@lo:400: Request processed in 85us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518040.061662:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518040.061679:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518040.061686:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522589952:12345-0@lo:400: 00000100:00100000:3.0:1789518040.061713:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522589952:12345-0@lo:400: Request processed in 28us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518040.061718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789518040.061787:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e74317c1500 x1876445522589440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518040.061801:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522589440:0@lo:400: 00010000:00080000:2.0:1789518040.061812:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435f22d80 x1876445522589952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518040.061821:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522589952:0@lo:400: 00010000:00010000:1.0:1789518040.117698:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518040.565782:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518040.565803:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522590208:0@lo:13: 00000100:00100000:0.0:1789518040.565866:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518040.565933:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590208 00000100:00100000:0.0:1789518040.565940:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590208 00000100:00100000:0.0:1789518040.565979:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518040.565986:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522590208:12345-0@lo:13: 00002000:00000024:0.0:1789518040.566015:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518040.566063:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522590208:12345-0@lo:13: Request processed in 79us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518040.566068:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789518040.566101:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7302834700 x1876445522590208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518040.566116:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522590208:0@lo:13: 00000020:00000004:0.0:1789518041.081143:0:8957:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789518041.081502:0:8957:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518041.161312:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518042.167043:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789518042.505053:0:9005:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518042.505066:0:9005:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1789518043.130290:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522590336:0@lo:13: 00000100:00100000:2.0:1789518043.130383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518043.130412:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522590592:0@lo:41: 00000100:00100000:3.0:1789518043.130446:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518043.130490:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518043.130496:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522590464:0@lo:41: 00000100:00100000:3.0:1789518043.130541:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518043.130584:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590592 00000100:00100000:3.0:1789518043.130593:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590592 00000100:00100000:3.0:1789518043.130639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590464 00000100:00100000:3.0:1789518043.130642:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590464 00000100:00100000:3.0:1789518043.130659:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518043.130681:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522590592:12345-0@lo:41: 00000004:00000024:3.0:1789518043.130732:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789518043.130785:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522590592:12345-0@lo:41: Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518043.130799:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518043.130820:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518043.130826:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522590464:12345-0@lo:41: 00000004:00000024:3.0:1789518043.130845:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789518043.130874:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522590464:12345-0@lo:41: Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518043.130880:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518043.130921:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522590464:0@lo:41: 00000100:00100000:3.0:1789518043.130934:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522590592:0@lo:41: 00000100:00100000:0.0:1789518043.131054:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590336 00000100:00100000:0.0:1789518043.131059:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590336 00000100:00100000:0.0:1789518043.131109:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518043.131118:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522590336:12345-0@lo:13: 00002000:00000024:0.0:1789518043.131138:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518043.131175:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522590336:12345-0@lo:13: Request processed in 59us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518043.131180:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789518043.131420:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435f08000 x1876445522590336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518043.131436:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522590336:0@lo:13: 00000100:00080000:3.0:1789518043.131641:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518043.189647:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518044.228587:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518045.176628:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522590976:0@lo:400: 00000100:00100000:1.0:1789518045.176699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518045.176752:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522591488:0@lo:400: 00000100:00100000:1.0:1789518045.176778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518045.176809:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789518045.176815:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522591104:0@lo:400: 00000100:00100000:1.0:1789518045.176836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518045.176853:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522591616:0@lo:400: 00000100:00100000:1.0:1789518045.176878:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518045.176906:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522591488 00000100:00100000:1.0:1789518045.176915:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522591488 00000100:00100000:1.0:1789518045.176965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522591104 00000100:00100000:1.0:1789518045.176967:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522591104 00000100:00100000:1.0:1789518045.176978:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522591616 00000100:00100000:1.0:1789518045.176986:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522591616 00000100:00100000:1.0:1789518045.177002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518045.177009:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522591488:12345-0@lo:400: 00000100:00100000:1.0:1789518045.177056:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522591488:12345-0@lo:400: Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518045.177063:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518045.177089:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518045.177094:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522591104:12345-0@lo:400: 00000100:00100000:1.0:1789518045.177115:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522591104:12345-0@lo:400: Request processed in 21us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518045.177119:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518045.177128:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518045.177133:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522591616:12345-0@lo:400: 00000100:00100000:1.0:1789518045.177151:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522591616:12345-0@lo:400: Request processed in 18us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518045.177157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789518045.177192:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965880 x1876445522591104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518045.177205:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522591104:0@lo:400: 00010000:00080000:1.0:1789518045.177214:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e74317c1500 x1876445522591616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518045.177234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522591616:0@lo:400: 00010000:00080000:1.0:1789518045.177243:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301964e00 x1876445522591488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518045.177250:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522591488:0@lo:400: 00000100:00100000:3.0:1789518045.177347:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522590720:0@lo:400: 00000100:00100000:3.0:1789518045.177385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518045.177421:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522591232:0@lo:400: 00000100:00100000:3.0:1789518045.177441:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518045.177457:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522591744:0@lo:400: 00000100:00100000:3.0:1789518045.177498:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518045.177518:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789518045.177523:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522590848:0@lo:400: 00000100:00100000:3.0:1789518045.177540:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518045.177552:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522591360:0@lo:400: 00000100:00100000:3.0:1789518045.177567:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518045.177592:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590976 00000100:00100000:3.0:1789518045.177595:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590976 00000100:00100000:3.0:1789518045.177614:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522591232 00000100:00100000:3.0:1789518045.177616:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522591232 00000100:00100000:3.0:1789518045.177634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518045.177639:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522590976:12345-0@lo:400: 00000100:00100000:3.0:1789518045.177675:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522590976:12345-0@lo:400: Request processed in 36us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518045.177682:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518045.177695:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789518045.177700:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522591232:12345-0@lo:400: 00000100:00100000:3.0:1789518045.177730:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522591232:12345-0@lo:400: Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518045.177734:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789518045.177749:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590848 00000100:00100000:3.0:1789518045.177753:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590848 00000100:00100000:3.0:1789518045.177770:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518045.177775:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522590848:12345-0@lo:400: 00000100:00100000:3.0:1789518045.177801:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522590848:12345-0@lo:400: Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518045.177807:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789518045.177822:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518045.177825:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518045.177837:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522591744 00000100:00100000:3.0:1789518045.177840:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522591744 00000100:00100000:3.0:1789518045.177865:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522591360 00000100:00100000:3.0:1789518045.177868:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522591360 00000100:00100000:3.0:1789518045.177881:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518045.177886:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522591744:12345-0@lo:400: 00000100:00100000:3.0:1789518045.177913:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522591744:12345-0@lo:400: Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518045.177918:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518045.177936:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518045.177941:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522591360:12345-0@lo:400: 00000100:00100000:3.0:1789518045.177967:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522591360:12345-0@lo:400: Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518045.177972:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789518045.177992:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789518045.178008:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965180 x1876445522590848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518045.178019:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522590848:0@lo:400: 00010000:00080000:3.0:1789518045.178028:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965f80 x1876445522591360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518045.178035:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522591360:0@lo:400: 00000100:00100000:3.0:1789518045.178042:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522591232:0@lo:400: 00010000:00080000:3.0:1789518045.178050:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e74317c0000 x1876445522591744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518045.178057:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522591744:0@lo:400: 00000100:00100000:3.0:1789518045.178082:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522590976:0@lo:400: 00000100:00100000:1.0:1789518045.178563:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522590720 00000100:00100000:1.0:1789518045.178568:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522590720 00000100:00100000:1.0:1789518045.178608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789518045.178615:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3639:x1876445522590720:12345-0@lo:400: 00000100:00100000:1.0:1789518045.178667:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3639:x1876445522590720:12345-0@lo:400: Request processed in 53us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518045.178674:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789518045.178754:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522590720:0@lo:400: 00010000:00010000:3.0:1789518045.241608:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518045.702523:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522591872:0@lo:13: 00000100:00100000:0.0:1789518045.702604:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518045.702681:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522591872 00000100:00100000:0.0:1789518045.702689:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522591872 00000100:00100000:0.0:1789518045.702733:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518045.702743:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522591872:12345-0@lo:13: 00002000:00000024:0.0:1789518045.702776:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518045.702823:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522591872:12345-0@lo:13: Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518045.702829:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789518045.702887:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7302834380 x1876445522591872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518045.702905:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522591872:0@lo:13: 00010000:00010000:1.0:1789518046.264763:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518047.287967:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518048.253624:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522592256:0@lo:41: 00000100:00100000:0.0:1789518048.253696:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518048.254404:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592256 00000100:00100000:1.0:1789518048.254418:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592256 00000100:00100000:1.0:1789518048.254494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518048.254505:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522592256:12345-0@lo:41: 00000004:00000024:1.0:1789518048.254546:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789518048.254607:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522592256:12345-0@lo:41: Request processed in 103us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518048.254615:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518048.254716:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522592256:0@lo:41: 00000100:00100000:3.0:1789518048.255421:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522592000:0@lo:13: 00000100:00100000:3.0:1789518048.255507:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.255555:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518048.255563:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522592128:0@lo:41: 00000100:00100000:3.0:1789518048.255588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.255636:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592000 00000100:00100000:3.0:1789518048.255642:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592000 00000100:00100000:3.0:1789518048.255687:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518048.255696:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522592000:12345-0@lo:13: 00002000:00000024:3.0:1789518048.255722:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518048.255763:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522592000:12345-0@lo:13: Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518048.255769:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789518048.255790:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789518048.255817:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7404810e00 x1876445522592000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518048.255833:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522592000:0@lo:13: 00000100:00100000:3.0:1789518048.257102:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592128 00000100:00100000:3.0:1789518048.257112:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592128 00000100:00100000:3.0:1789518048.257164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518048.257173:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522592128:12345-0@lo:41: 00000004:00000024:3.0:1789518048.257215:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789518048.257276:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522592128:12345-0@lo:41: Request processed in 104us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518048.257284:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518048.258002:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522592128:0@lo:41: 00010000:00010000:3.0:1789518048.311307:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518049.333833:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518050.293891:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522592768:0@lo:400: 00000100:00100000:3.0:1789518050.293904:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522592384:0@lo:400: 00000100:00100000:3.0:1789518050.293962:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518050.293962:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518050.294032:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592768 00000100:00100000:1.0:1789518050.294042:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592768 00000100:00100000:1.0:1789518050.294118:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518050.294129:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522592768:12345-0@lo:400: 00000100:00100000:0.0:1789518050.294199:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522593280:0@lo:400: 00000100:00100000:0.0:1789518050.294224:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518050.294451:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522592896:0@lo:400: 00000100:00100000:3.0:1789518050.294503:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518050.295273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522593408:0@lo:400: 00000100:00100000:3.0:1789518050.295313:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518050.295351:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522592512:0@lo:400: 00000100:00100000:3.0:1789518050.295371:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518050.295385:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522593024:0@lo:400: 00000100:00100000:3.0:1789518050.295401:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518050.295416:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789518050.295422:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522592640:0@lo:400: 00000100:00100000:3.0:1789518050.295439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518050.295452:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522593152:0@lo:400: 00000100:00100000:3.0:1789518050.295486:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518050.295508:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593280 00000100:00100000:3.0:1789518050.295514:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593280 00000100:00100000:3.0:1789518050.295547:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592512 00000100:00100000:3.0:1789518050.295549:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592512 00000100:00100000:3.0:1789518050.295560:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593152 00000100:00100000:3.0:1789518050.295561:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593152 00000100:00100000:3.0:1789518050.295575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518050.295582:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522593280:12345-0@lo:400: 00000100:00100000:3.0:1789518050.295621:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522593280:12345-0@lo:400: Request processed in 39us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518050.295628:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518050.295646:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518050.295652:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522592512:12345-0@lo:400: 00000100:00100000:3.0:1789518050.295691:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522592512:12345-0@lo:400: Request processed in 39us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518050.295697:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789518050.295757:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7404812300 x1876445522592512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518050.295771:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522592512:0@lo:400: 00000100:00100000:3.0:1789518050.296006:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518050.296016:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522593152:12345-0@lo:400: 00000100:00100000:3.0:1789518050.296062:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522593152:12345-0@lo:400: Request processed in 49us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518050.296068:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518050.296092:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592896 00000100:00100000:3.0:1789518050.296096:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592896 00000100:00100000:3.0:1789518050.296188:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592640 00000100:00100000:3.0:1789518050.296191:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592640 00000100:00100000:3.0:1789518050.296205:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518050.296210:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522592896:12345-0@lo:400: 00000100:00100000:3.0:1789518050.296251:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522592896:12345-0@lo:400: Request processed in 40us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518050.296257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518050.296269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518050.296275:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522592640:12345-0@lo:400: 00000100:00100000:3.0:1789518050.296303:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522592640:12345-0@lo:400: Request processed in 28us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518050.296308:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518050.296326:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593408 00000100:00100000:3.0:1789518050.296330:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593408 00000100:00100000:3.0:1789518050.296353:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593024 00000100:00100000:3.0:1789518050.296356:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593024 00000100:00100000:3.0:1789518050.296370:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518050.296375:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522593408:12345-0@lo:400: 00000100:00100000:3.0:1789518050.296420:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522593408:12345-0@lo:400: Request processed in 44us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518050.296426:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518050.296444:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518050.296450:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522593024:12345-0@lo:400: 00000100:00100000:2.0:1789518050.296495:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522592640:0@lo:400: 00010000:00080000:2.0:1789518050.296508:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7404811f80 x1876445522593152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518050.296517:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522593152:0@lo:400: 00000100:00100000:1.0:1789518050.297672:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522592768:12345-0@lo:400: Request processed in 3540us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518050.297684:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518050.297721:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522592384 00000100:00100000:1.0:1789518050.297726:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522592384 00000100:00100000:3.0:1789518050.297743:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522593024:12345-0@lo:400: Request processed in 1293us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518050.297750:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518050.297759:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789518050.297776:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3640:x1876445522592384:12345-0@lo:400: 00000100:00100000:1.0:1789518050.297817:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3640:x1876445522592384:12345-0@lo:400: Request processed in 42us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518050.297824:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1789518050.297964:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518050.297970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518050.297973:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789518050.298023:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7404810a80 x1876445522593024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518050.298036:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522593024:0@lo:400: 00000100:00100000:3.0:1789518050.298067:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522592384:0@lo:400: 00000100:00100000:3.0:1789518050.298077:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522592896:0@lo:400: 00010000:00080000:3.0:1789518050.298088:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7404810e00 x1876445522593408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518050.298095:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522593408:0@lo:400: 00010000:00080000:0.0:1789518050.299376:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7404812680 x1876445522592768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518050.299391:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522592768:0@lo:400: 00010000:00080000:0.0:1789518050.299404:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7404812a00 x1876445522593280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518050.299411:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522593280:0@lo:400: 00010000:00010000:1.0:1789518050.357736:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518050.805921:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518050.805949:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522593536:0@lo:13: 00000100:00100000:0.0:1789518050.806018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518050.806090:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593536 00000100:00100000:0.0:1789518050.806309:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593536 00000100:00100000:0.0:1789518050.806369:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518050.806378:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522593536:12345-0@lo:13: 00002000:00000024:0.0:1789518050.806412:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518050.806498:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522593536:12345-0@lo:13: Request processed in 121us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518050.806506:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789518050.806552:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7302837100 x1876445522593536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518050.806571:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522593536:0@lo:13: 00010000:00010000:0.0:1789518051.382602:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518052.406709:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518053.365724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522593664:0@lo:13: 00000100:00100000:3.0:1789518053.365806:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518053.366062:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522593792:0@lo:41: 00000100:00100000:0.0:1789518053.366101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.366206:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593664 00000100:00100000:3.0:1789518053.366216:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593664 00000100:00100000:3.0:1789518053.366290:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518053.366302:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522593664:12345-0@lo:13: 00002000:00000024:3.0:1789518053.366341:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518053.366397:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522593664:12345-0@lo:13: Request processed in 97us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.366422:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518053.366457:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593792 00000100:00100000:3.0:1789518053.366497:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593792 00000100:00100000:3.0:1789518053.366523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518053.366530:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522593792:12345-0@lo:41: 00000004:00000024:3.0:1789518053.366556:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789518053.366600:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522593792:12345-0@lo:41: Request processed in 71us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.366607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518053.366661:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522593792:0@lo:41: 00010000:00080000:3.0:1789518053.366696:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435f23480 x1876445522593664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518053.366711:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522593664:0@lo:13: 00000100:00080000:0.0:1789518053.366822:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518053.367012:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522593920:0@lo:41: 00000100:00100000:0.0:1789518053.367050:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.367128:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522593920 00000100:00100000:3.0:1789518053.367133:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522593920 00000100:00100000:3.0:1789518053.367167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518053.367173:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522593920:12345-0@lo:41: 00000004:00000024:3.0:1789518053.367191:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789518053.373621:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522593920:12345-0@lo:41: Request processed in 6435us (6558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.373640:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518053.373775:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522593920:0@lo:41: 00000020:01000004:3.0:1789518053.408024:0:9505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789518053.408029:0:9505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789518053.408032:0:9505:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789518053.408162:0:9505:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e730205a000 00000020:01000004:3.0:1789518053.408179:0:9505:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789518053.408194:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789518053.408215:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e74317c8000) 00000020:00000080:3.0:1789518053.408233:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1789518053.435454:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789518053.481899:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789518053.481969:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1789518053.512161:0:9505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789518053.512386:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789518053.512401:0:9505:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789518053.512414:0:9505:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8d0fd6794231409f 00000020:01000004:1.0:1789518053.512422:0:9505:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789518053.512446:0:9505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789518053.512450:0:9505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789518053.512457:0:9505:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789518053.512514:0:9505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789518053.512520:0:9505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789518053.579730:0:9505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518053.579771:0:9505:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.143@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789518053.579776:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518053.579778:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518053.579780:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518053.579781:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518053.579782:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518053.579784:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518053.579786:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518053.579787:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789518053.579788:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789518053.579791:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518053.579792:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518053.579795:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789518053.579798:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518053.579799:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518053.579950:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518053.579952:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518053.579953:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518053.579954:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518053.579955:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518053.579956:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789518053.579956:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789518053.579957:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518053.579958:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518053.580000:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789518053.580021:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522594048:0@lo:253: 00000100:00100000:1.0:1789518053.580091:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.580204:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dc74f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518053.580266:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594048 00000100:00100000:0.0:1789518053.580276:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594048 00000100:00100000:1.0:1789518053.580417:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789518053.580427:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:9505:x1876445522594048:12345-0@lo:253: 20000000:01000000:1.0:1789518053.580456:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789518053.580492:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789518053.580500:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789518053.580503:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789518053.580727:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518053.581191:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789518053.581207:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789518053.581224:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789518053.581230:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789518053.581242:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789518053.581256:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789518053.581340:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789518053.581355:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:1.0:1789518053.581358:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789518053.581371:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789518053.581376:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789518053.581387:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789518053.581392:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:1.0:1789518053.581413:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789518053.581420:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789518053.581444:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789518053.581458:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789518053.582026:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789518053.582040:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:1.0:1789518053.582042:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789518053.582057:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789518053.582062:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789518053.582074:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789518053.582078:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:1.0:1789518053.582090:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789518053.582096:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789518053.582107:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789518053.582120:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789518053.582828:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789518053.582854:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:0.0:1789518053.582856:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789518053.582873:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789518053.582879:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789518053.582892:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789518053.582897:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:0.0:1789518053.582910:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789518053.582916:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789518053.582928:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789518053.582943:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789518053.582966:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789518053.582969:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789518053.582974:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789518053.583022:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789518053.583025:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789518053.583614:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789518053.583832:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789518053.583963:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789518053.583981:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789518053.583992:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789518053.583994:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518053.584296:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518053.584316:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518053.584331:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789518053.584490:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789518053.584516:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789518053.584531:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1789518053.584539:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789518053.584541:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518053.585020:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518053.585039:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518053.585053:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789518053.586032:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789518053.586061:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789518053.586077:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789518053.586089:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789518053.586092:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518053.587183:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518053.587214:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518053.587229:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789518053.587459:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789518053.587586:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789518053.587601:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789518053.587611:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789518053.587613:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518053.588023:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518053.588053:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518053.588064:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789518053.588226:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789518053.588245:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789518053.588260:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:1.0:1789518053.588275:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789518053.588295:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588389:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588399:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588405:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588411:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588417:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314036 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588423:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314052 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588430:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231407c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588437:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588539:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd6794231407c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588557:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd6794231407c expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.588586:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594176:0@lo:104: 00000100:00100000:1.0:1789518053.588662:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518053.588746:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314052 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588756:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314052 expref: 21 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.588766:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594304:0@lo:104: 00000100:00100000:1.0:1789518053.588787:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518053.588878:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314036 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.588886:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314036 expref: 21 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.588895:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594432:0@lo:104: 00000100:00100000:1.0:1789518053.588914:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.589099:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594176 00000100:00100000:2.0:1789518053.589108:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594176 00000100:00100000:2.0:1789518053.589153:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594304 00000100:00100000:2.0:1789518053.589156:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594304 00000100:00100000:2.0:1789518053.589172:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518053.589182:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522594176:12345-0@lo:104: 00010000:00010000:2.0:1789518053.589195:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589254:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518053.589261:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522594176:12345-0@lo:104: Request processed in 80us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.589268:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518053.589285:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518053.589291:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522594304:12345-0@lo:104: 00010000:00010000:2.0:1789518053.589299:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589428:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789518053.589434:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522594304:12345-0@lo:104: Request processed in 144us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.589441:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789518053.589504:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518053.589510:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589519:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d600 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518053.589524:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589534:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518053.589543:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518053.589549:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518053.589578:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589585:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518053.589600:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589609:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd6794231407c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314083 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589634:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518053.589638:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589644:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518053.589647:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589655:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518053.589663:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518053.589668:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518053.589680:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589685:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518053.589690:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589697:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400030400/0x8d0fd67942314052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314059 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.589707:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518053.589708:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518053.589710:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.589822:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518053.589953:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522594560:0@lo:103: 00000100:00100000:3.0:1789518053.589990:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.590031:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518053.590038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522594688:0@lo:103: 00000100:00100000:3.0:1789518053.590071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.590106:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594560 00000100:00100000:3.0:1789518053.590111:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594560 00010000:00010000:3.0:1789518053.590133:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231407c expref: 22 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518053.590167:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594688 00000100:00100000:3.0:1789518053.590170:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594688 00010000:00010000:3.0:1789518053.590182:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314052 expref: 23 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518053.590194:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518053.590200:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:3637:x1876445522594560:12345-0@lo:103: 00010000:00010000:3.0:1789518053.590212:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518053.590217:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231407c expref: 23 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.590228:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd6794231407c expref: 23 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.590244:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518053.590271:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:3637:x1876445522594560:12345-0@lo:103: Request processed in 71us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.590288:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518053.590304:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518053.590310:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302aba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3637:x1876445522594688:12345-0@lo:103: 00010000:00010000:3.0:1789518053.590318:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518053.590322:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314052 expref: 22 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.590348:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314052 expref: 22 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.590358:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518053.590380:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302aba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3637:x1876445522594688:12345-0@lo:103: Request processed in 71us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.590386:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518053.590421:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522594688:0@lo:103: 00000100:00100000:3.0:1789518053.590430:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522594560:0@lo:103: 00010000:00010000:1.0:1789518053.590596:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.590607:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 21 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.590618:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594816:0@lo:104: 00000100:00100000:1.0:1789518053.590641:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518053.590657:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.590676:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.590685:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594944:0@lo:104: 00000100:00100000:1.0:1789518053.590708:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518053.590723:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.590731:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 21 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.590738:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522595072:0@lo:104: 00010000:00010000:1.0:1789518053.590761:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.590768:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 21 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.590775:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522595200:0@lo:104: 00000100:00100000:1.0:1789518053.590792:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759d80 going to sleep for 11 seconds 00010000:00010000:1.0:1789518053.590805:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcec00/0x8d0fd67942314083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd6794231407c expref: 21 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.590826:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594176:0@lo:104: 00010000:00010000:1.0:1789518053.590835:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030800/0x8d0fd67942314059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314052 expref: 20 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.590973:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594304:0@lo:104: 00000100:00100000:3.0:1789518053.591183:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789518053.591202:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.591215:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.591222:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594432 00000100:00100000:3.0:1789518053.591227:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594432 00000100:00100000:3.0:1789518053.591253:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594816 00000100:00100000:3.0:1789518053.591256:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594816 00000100:00100000:3.0:1789518053.591265:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522594944 00000100:00100000:3.0:1789518053.591267:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522594944 00000100:00100000:3.0:1789518053.591276:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595072 00000100:00100000:3.0:1789518053.591277:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595072 00000100:00100000:3.0:1789518053.591285:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595200 00000100:00100000:3.0:1789518053.591293:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595200 00000100:00100000:3.0:1789518053.591308:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789518053.591315:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+7:6506:x1876445522594432:12345-0@lo:104: 00010000:00010000:3.0:1789518053.591336:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.591391:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518053.591397:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+7:6506:x1876445522594432:12345-0@lo:104: Request processed in 83us (2482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.591404:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789518053.591418:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518053.591424:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:6506:x1876445522594816:12345-0@lo:104: 00010000:00010000:3.0:1789518053.591432:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.591500:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789518053.591507:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:6506:x1876445522594816:12345-0@lo:104: Request processed in 83us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.591514:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518053.591526:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518053.591532:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301968450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6506:x1876445522594944:12345-0@lo:104: 00010000:00010000:3.0:1789518053.591540:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.591573:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789518053.591578:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301968450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:6506:x1876445522594944:12345-0@lo:104: Request processed in 47us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.591585:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518053.591620:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518053.591626:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522595072:12345-0@lo:104: 00010000:00010000:3.0:1789518053.591634:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.591659:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789518053.591664:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6506:x1876445522595072:12345-0@lo:104: Request processed in 39us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.591670:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518053.591680:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518053.591686:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522595200:12345-0@lo:104: 00010000:00010000:3.0:1789518053.591693:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.591714:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789518053.591718:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6506:x1876445522595200:12345-0@lo:104: Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.591723:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1789518053.591737:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789518053.591743:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.591751:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.591756:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.591765:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.591783:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.591789:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789518053.592065:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594432:0@lo:104: 00000100:00100000:1.0:1789518053.592074:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594816:0@lo:104: 00000100:00100000:1.0:1789518053.592081:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522594944:0@lo:104: 00000100:00100000:1.0:1789518053.592087:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522595072:0@lo:104: 00000100:00100000:1.0:1789518053.592094:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876445522595200:0@lo:104: 00010000:00010000:1.0:1789518053.592120:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.592181:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.592190:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789518053.592233:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522595328:0@lo:103: 00000100:00100000:1.0:1789518053.592267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.592350:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595328 00000100:00100000:2.0:1789518053.592364:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595328 00010000:00010000:2.0:1789518053.592386:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314036 expref: 20 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.592409:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518053.592415:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3639:x1876445522595328:12345-0@lo:103: 00010000:00010000:2.0:1789518053.592424:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518053.592429:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314036 expref: 20 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.592438:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314036 expref: 20 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.592451:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231403d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314036 expref: 20 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.592479:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518053.592552:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.592560:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400031e00/0x8d0fd67942314036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231403d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.592572:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789518053.592576:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.592582:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.592585:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.592592:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.592598:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.592604:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518053.592627:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.592633:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789518053.593081:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3639:x1876445522595328:12345-0@lo:103: Request processed in 664us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.593089:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518053.593151:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522595328:0@lo:103: 00000100:00100000:0.0:1789518053.593166:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518053.593174:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522595456:0@lo:103: 00000100:00100000:0.0:1789518053.593206:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518053.593351:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593361:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942313ff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313ff7 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593373:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789518053.593376:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593382:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0dc00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.593385:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593392:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.593398:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.593403:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518053.593423:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593430:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789518053.593493:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522595584:0@lo:103: 00000100:00100000:0.0:1789518053.593520:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518053.593565:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593585:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0dc00/0x8d0fd67942313fd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fdb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593596:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518053.593600:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593606:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dce800 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.593610:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593618:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.593625:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.593631:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518053.593644:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593651:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518053.593656:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593664:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dce800/0x8d0fd67942313fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fb8 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593672:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518053.593680:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593687:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0ce00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.593690:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593697:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.593704:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.593709:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518053.593720:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593725:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518053.593735:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593742:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0ce00/0x8d0fd67942313f87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f8e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.593755:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.593757:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.593759:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518053.593767:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518053.593776:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522595840:0@lo:103: 00000100:00100000:1.0:1789518053.594006:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522595712:0@lo:103: 00000100:00100000:2.0:1789518053.594120:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595456 00000100:00100000:2.0:1789518053.594128:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595456 00010000:00010000:2.0:1789518053.594162:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 19 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.594179:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595584 00000100:00100000:2.0:1789518053.594182:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595584 00010000:00010000:2.0:1789518053.594193:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 20 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.594203:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518053.594218:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3639:x1876445522595456:12345-0@lo:103: 00010000:00010000:2.0:1789518053.594230:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518053.594235:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 20 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594245:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 20 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594257:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942313ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313ff0 expref: 20 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594270:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518053.594301:0:6499:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789518053.594310:0:6499:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789518053.594344:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.594351:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518053.594361:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789518053.594369:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518053.594375:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3637:x1876445522595584:12345-0@lo:103: 00010000:00010000:3.0:1789518053.594383:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518053.594388:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 19 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.594397:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 19 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.594406:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030a00/0x8d0fd67942313fdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313fd4 expref: 19 pid: 6505 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.594415:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518053.594444:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518053.594548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.594715:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3639:x1876445522595456:12345-0@lo:103: Request processed in 497us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.594723:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518053.594763:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789518053.594767:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595712 00000100:00100000:2.0:1789518053.594771:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595712 00010000:00010000:2.0:1789518053.594785:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 18 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.594797:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789518053.594800:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595840 00000100:00100000:2.0:1789518053.594803:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595840 00010000:00010000:2.0:1789518053.594824:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 19 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.594834:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789518053.594852:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518053.594858:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3638:x1876445522595712:12345-0@lo:103: 00010000:00010000:2.0:1789518053.594865:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518053.594877:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 19 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594885:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 19 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594896:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942313fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313fb1 expref: 19 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594904:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518053.594936:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3638:x1876445522595712:12345-0@lo:103: Request processed in 79us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.594941:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518053.594952:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789518053.594957:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518053.594962:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:3640:x1876445522595840:12345-0@lo:103: 00010000:00010000:2.0:1789518053.594968:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518053.594972:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 17 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594980:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 17 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.594989:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d200/0x8d0fd67942313f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313f87 expref: 17 pid: 6507 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595000:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595008:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595031:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595038:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595045:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595052:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595058:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518053.595063:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595071:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595082:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.595091:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518053.595112:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3640:x1876445522595840:12345-0@lo:103: Request processed in 151us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.595118:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518053.595248:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522595712:0@lo:103: 00010000:00010000:1.0:1789518053.595270:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.595278:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.595285:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423140a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518053.595297:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789518053.596077:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522595840:0@lo:103: 00000100:00100000:0.0:1789518053.596100:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522595456:0@lo:103: 00000100:00100000:3.0:1789518053.596736:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3637:x1876445522595584:12345-0@lo:103: Request processed in 2357us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.596745:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518053.597056:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522595584:0@lo:103: 00000100:00100000:1.0:1789518053.598454:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:9505:x1876445522594048:12345-0@lo:253: Request processed in 18021us (18356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.598496:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789518053.598671:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522594048:0@lo:253: 10000000:01000000:2.0:1789518053.598687:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789518053.598691:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518053.598700:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518053.598701:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518053.598703:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789518053.598704:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518053.598706:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518053.598707:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518053.598709:0:9505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789518053.598710:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518053.598712:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789518053.598735:0:9505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e730205a000 from lustre-OST0001 10000000:01000000:2.0:1789518053.598761:0:9505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789518053.598764:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789518053.598773:0:9505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e740dd9cd40 local copy 10000000:01000000:2.0:1789518053.598777:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789518053.598954:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.598967:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.598977:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.599000:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522595968:0@lo:101: 00000100:00100000:2.0:1789518053.599040:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.599112:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.599157:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522595968 00000100:00100000:1.0:1789518053.599167:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522595968 00000100:00100000:1.0:1789518053.599254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789518053.599265:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+14:9505:x1876445522595968:12345-0@lo:101: 00010000:00010000:1.0:1789518053.599279:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518053.599293:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d400/0x8d0fd679423140b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423140ad expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.599316:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d400/0x8d0fd679423140b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423140ad expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.599327:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0d400/0x8d0fd679423140b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423140ad expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.599336:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d400, rc 0) 00000100:00100000:1.0:1789518053.599376:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522595968:12345-0@lo:101: Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.599383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789518053.599445:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522595968:0@lo:101: 00010000:00010000:2.0:1789518053.599458:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.599497:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.599610:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596096:0@lo:501: 00000100:00100000:2.0:1789518053.599639:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.603491:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518053.603717:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596096 00000100:00100000:0.0:1789518053.603730:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596096 00000100:00100000:0.0:1789518053.603795:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789518053.603938:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522596096:12345-0@lo:501: 00000100:00100000:0.0:1789518053.604153:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522596096:12345-0@lo:501: Request processed in 348us (4512us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518053.604162:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789518053.604303:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596096:0@lo:501: 10000000:01000000:2.0:1789518053.604328:0:9505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789518053.604353:0:9505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789518053.604361:0:9505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.604372:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.604380:0:9505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.604439:0:9505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518053.604519:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e730205a000 10000000:01000000:2.0:1789518053.604525:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789518053.604530:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789518053.604532:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518053.604537:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789518053.604540:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789518053.604573:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.604581:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.604603:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.604621:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596224:0@lo:101: 00000100:00100000:2.0:1789518053.604659:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.604681:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518053.604748:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596224 00000100:00100000:0.0:1789518053.604754:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596224 00000100:00100000:0.0:1789518053.604784:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789518053.604792:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522596224:12345-0@lo:101: 00010000:00010000:0.0:1789518053.604802:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518053.604826:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423140bb expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.604860:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423140bb expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.604872:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423140bb expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.604881:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c800, rc 0) 00000100:00100000:0.0:1789518053.604921:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596224:12345-0@lo:101: Request processed in 130us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.604927:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789518053.605066:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596224:0@lo:101: 00010000:00010000:2.0:1789518053.605080:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.605089:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518053.605177:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596352:0@lo:501: 00000100:00100000:2.0:1789518053.605202:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.605227:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.605289:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596352 00000100:00100000:1.0:1789518053.605295:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596352 00000100:00100000:1.0:1789518053.605329:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789518053.605337:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596352:12345-0@lo:501: 00000100:00100000:1.0:1789518053.605438:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596352:12345-0@lo:501: Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.605445:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789518053.605496:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596352:0@lo:501: 00000100:00100000:1.0:1789518053.605524:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596480:0@lo:503: 00000100:00100000:1.0:1789518053.605562:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.605584:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.605597:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596480 00000100:00100000:1.0:1789518053.605601:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596480 00000100:00100000:1.0:1789518053.605618:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789518053.605623:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596480:12345-0@lo:503: 00000100:00100000:1.0:1789518053.605697:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596480:12345-0@lo:503: Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.605703:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789518053.605739:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596480:0@lo:503: 00000040:00080000:1.0:1789518053.606134:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518053.606216:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596608:0@lo:502: 00000100:00100000:1.0:1789518053.606251:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518053.606378:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518053.606387:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.606396:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.606401:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.606409:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.606416:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.606430:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518053.606452:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.606459:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518053.606494:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.606502:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423140ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8d0fd679423140b4 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.606517:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.606519:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.606521:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518053.606582:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518053.606751:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596608 00000100:00100000:2.0:1789518053.606757:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596608 00000100:00100000:2.0:1789518053.606794:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789518053.606906:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596608:12345-0@lo:502: 00000100:00100000:2.0:1789518053.607067:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596608:12345-0@lo:502: Request processed in 265us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.607075:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789518053.607172:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522596736:0@lo:103: 00000100:00100000:0.0:1789518053.607206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.607288:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596736 00000100:00100000:2.0:1789518053.607293:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596736 00000100:00100000:2.0:1789518053.607334:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518053.607342:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3640:x1876445522596736:12345-0@lo:103: 00010000:00010000:2.0:1789518053.607359:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518053.607377:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d400/0x8d0fd679423140b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd679423140ad expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518053.607392:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518053.607420:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3640:x1876445522596736:12345-0@lo:103: Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.607428:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518053.607685:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522596736:0@lo:103: 00000100:00100000:1.0:1789518053.607821:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596608:0@lo:502: 00000040:00080000:2.0:1789518053.608285:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789518053.608316:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789518053.608331:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789518053.608344:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789518053.608358:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789518053.608371:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789518053.608401:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596864:0@lo:502: 00000100:00100000:2.0:1789518053.608449:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518053.608649:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518053.608687:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596864 00000100:00100000:3.0:1789518053.608695:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596864 00000100:00100000:3.0:1789518053.608763:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789518053.608772:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522596864:12345-0@lo:502: 00000100:00100000:3.0:1789518053.609029:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522596864:12345-0@lo:502: Request processed in 258us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.609038:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789518053.609107:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596864:0@lo:502: 00000040:00080000:1.0:1789518053.609169:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789518053.609178:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789518053.609665:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518053.609673:0:9517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789518053.609680:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518053.609682:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789518053.609688:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518053.609713:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e7302ac0000) 00000020:00000080:1.0:1789518053.609737:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789518053.609743:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789518053.609801:0:9517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e730205a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789518053.609821:0:9517:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789518053.609828:0:9517:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8d0fd679423140d0 00010000:00010000:1.0:1789518053.616178:0:9517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789518053.616755:0:9517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789518053.619315:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789518053.619953:0:9517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789518053.624414:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789518053.625072:0:9517:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789518053.630695:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789518053.632038:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789518053.632059:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518053.632066:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518053.632069:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789518053.632072:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518053.632076:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518053.632078:0:9517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518053.632081:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518053.632083:0:9517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789518053.632105:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518053.632108:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518053.632109:0:9517:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789518053.632112:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789518053.633972:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789518053.634017:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789518053.634044:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.634059:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518053.634067:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e730205a000 from 1 10000000:01000000:1.0:1789518053.634070:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518053.634109:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.634117:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.634128:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.634185:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596992:0@lo:101: 00000100:00100000:1.0:1789518053.634260:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.634302:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518053.634384:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522596992 00000100:00100000:0.0:1789518053.634392:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522596992 00000100:00100000:0.0:1789518053.634448:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789518053.634459:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522596992:12345-0@lo:101: 00010000:00010000:0.0:1789518053.634493:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518053.634506:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423140d7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.634529:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.634539:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.634548:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c600, rc 0) 00000100:00100000:0.0:1789518053.634589:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522596992:12345-0@lo:101: Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.634596:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789518053.636089:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522596992:0@lo:101: 00010000:00010000:1.0:1789518053.636117:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.636168:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.636301:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597120:0@lo:501: 00000100:00100000:1.0:1789518053.636356:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.636401:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.636427:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522597120 00000100:00100000:1.0:1789518053.636433:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522597120 00000100:00100000:1.0:1789518053.636497:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789518053.636506:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597120:12345-0@lo:501: 00000100:00100000:1.0:1789518053.636618:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597120:12345-0@lo:501: Request processed in 113us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.636626:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789518053.636665:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597120:0@lo:501: 00000100:00100000:1.0:1789518053.636692:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597248:0@lo:503: 00000100:00100000:1.0:1789518053.636731:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.636748:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.636760:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522597248 00000100:00100000:1.0:1789518053.636764:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522597248 00000100:00100000:1.0:1789518053.636783:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789518053.636789:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597248:12345-0@lo:503: 00000100:00100000:1.0:1789518053.636893:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597248:12345-0@lo:503: Request processed in 103us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.636900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789518053.636942:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597248:0@lo:503: 00000040:00080000:1.0:1789518053.637228:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518053.637292:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597376:0@lo:502: 00000100:00100000:1.0:1789518053.637328:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.637345:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.637359:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522597376 00000100:00100000:1.0:1789518053.637363:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522597376 00000100:00100000:1.0:1789518053.637381:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789518053.637387:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597376:12345-0@lo:502: 00000100:00100000:1.0:1789518053.637459:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597376:12345-0@lo:502: Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.637490:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789518053.637530:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597376:0@lo:502: 00000040:00080000:1.0:1789518053.637711:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789518053.637734:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789518053.637753:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597504:0@lo:502: 00000100:00100000:1.0:1789518053.637783:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.637807:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.637821:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522597504 00000100:00100000:1.0:1789518053.637825:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522597504 00000100:00100000:1.0:1789518053.637842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789518053.637847:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597504:12345-0@lo:502: 00000100:00100000:1.0:1789518053.637911:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597504:12345-0@lo:502: Request processed in 62us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.637918:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789518053.637954:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597504:0@lo:502: 00000040:00080000:1.0:1789518053.637988:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789518053.638000:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789518053.638285:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518053.638295:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518053.638298:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789518053.638305:0:9521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e730205a000 00000020:00000080:1.0:1789518053.638307:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518053.638318:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518053.638321:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518053.638323:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789518053.638325:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789518053.638354:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789518053.638378:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518053.638388:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.638400:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518053.638447:0:9505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518053.638451:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e730205a000 10000000:01000000:1.0:1789518053.638455:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e730205a000 10000000:01000000:1.0:1789518053.638459:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518053.638495:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e730205a000 from 1 10000000:01000000:1.0:1789518053.638499:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518053.638526:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.638536:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.638546:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.638572:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597632:0@lo:101: 00000100:00100000:1.0:1789518053.638605:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.638628:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.638645:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522597632 00000100:00100000:1.0:1789518053.638650:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522597632 00000100:00100000:1.0:1789518053.638673:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789518053.638680:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9505:x1876445522597632:12345-0@lo:101: 00010000:00010000:1.0:1789518053.638691:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518053.638704:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423140e5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.638725:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.638737:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.638747:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c800, rc 0) 00000100:00100000:1.0:1789518053.638779:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522597632:12345-0@lo:101: Request processed in 100us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.638786:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789518053.638823:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597632:0@lo:101: 00010000:00010000:1.0:1789518053.638837:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.638846:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.638923:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597760:0@lo:501: 00000100:00100000:1.0:1789518053.638950:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.638964:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518053.638977:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522597760 00000100:00100000:1.0:1789518053.638981:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522597760 00000100:00100000:1.0:1789518053.638999:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789518053.639005:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522597760:12345-0@lo:501: 00000100:00100000:1.0:1789518053.639102:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522597760:12345-0@lo:501: Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.639109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789518053.643613:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597760:0@lo:501: 00000100:00100000:1.0:1789518053.643690:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597888:0@lo:503: 00000100:00100000:1.0:1789518053.643773:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.644664:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518053.645443:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522597888 00000100:00100000:2.0:1789518053.645454:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522597888 00000100:00100000:2.0:1789518053.645661:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789518053.645674:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522597888:12345-0@lo:503: 00000100:00100000:3.0:1789518053.646158:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522597888:0@lo:503: 00000040:00080000:3.0:1789518053.646457:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518053.646570:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302abb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522598016:0@lo:502: 00000100:00100000:2.0:1789518053.646655:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522597888:12345-0@lo:503: Request processed in 983us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.646665:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789518053.647083:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.647165:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518053.647205:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598016 00000100:00100000:2.0:1789518053.647211:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598016 00000100:00100000:2.0:1789518053.647252:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789518053.647264:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522598016:12345-0@lo:502: 00000100:00100000:2.0:1789518053.647391:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522598016:12345-0@lo:502: Request processed in 129us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.647399:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789518053.647508:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302abb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522598016:0@lo:502: 00000040:00080000:3.0:1789518053.647742:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789518053.647770:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789518053.647784:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789518053.647796:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789518053.647809:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789518053.647849:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789518053.648045:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789518053.648061:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789518053.648075:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789518053.648088:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789518053.648101:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789518053.648114:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789518053.648127:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789518053.648150:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789518053.648167:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789518053.648180:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789518053.648194:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789518053.648206:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789518053.648219:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789518053.648231:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789518053.648243:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789518053.648256:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789518053.648269:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789518053.648283:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789518053.648296:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789518053.648309:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789518053.648321:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789518053.648334:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789518053.648346:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789518053.648359:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789518053.648371:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789518053.648383:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789518053.648408:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789518053.648435:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789518053.648450:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789518053.648491:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789518053.648507:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1789518053.648520:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789518053.648533:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1789518053.648545:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1789518053.648558:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1789518053.648570:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1789518053.648582:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1789518053.648595:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1789518053.648608:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1789518053.648621:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1789518053.648655:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302abb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522598144:0@lo:502: 00000100:00100000:3.0:1789518053.648707:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.648733:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518053.648827:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598144 00000100:00100000:2.0:1789518053.648834:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598144 00000100:00100000:2.0:1789518053.648885:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789518053.649057:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522598144:12345-0@lo:502: 00000100:00100000:2.0:1789518053.649168:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522598144:12345-0@lo:502: Request processed in 274us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.649176:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789518053.649406:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302abb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522598144:0@lo:502: 00000040:00080000:3.0:1789518053.649460:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789518053.649579:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789518053.650405:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789518053.650429:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e73030e99c0) 00000020:00000080:2.0:1789518053.650454:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789518053.651203:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e730205a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789518053.651210:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e730205a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789518053.651213:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e730205a000 3 00010000:00080000:2.0:1789518053.651245:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7437796800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789518053.654137:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789518053.654427:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789518053.654512:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789518053.654525:0:9522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8d0fd679423140fa 00000100:00080000:2.0:1789518053.654536:0:9522:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518053.654547:0:9522:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e7437796800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518053.654589:0:9522:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435f09500 x1876445522598272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518053.654612:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789518053.654693:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522598272:0@lo:38: 00000100:00100000:0.0:1789518053.654769:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.655137:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522598528:0@lo:400: 00000100:00100000:1.0:1789518053.655179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.655203:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789518053.655209:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522598400:0@lo:400: 00000100:00100000:1.0:1789518053.655227:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.655242:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522598912:0@lo:400: 00000100:00100000:1.0:1789518053.655265:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.655294:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598272 00000100:00100000:1.0:1789518053.655301:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598272 00000100:00100000:1.0:1789518053.655330:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598528 00000100:00100000:1.0:1789518053.655334:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598528 00000100:00100000:1.0:1789518053.655363:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598400 00000100:00100000:1.0:1789518053.655366:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598400 00000100:00100000:1.0:1789518053.655380:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518053.655388:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522598528:12345-0@lo:400: 00000100:00100000:1.0:1789518053.655439:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522598528:12345-0@lo:400: Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.655446:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518053.655484:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518053.655492:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522598400:12345-0@lo:400: 00000100:00100000:1.0:1789518053.655517:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522598400:12345-0@lo:400: Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.655523:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518053.655536:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518053.655540:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1876445522598272:12345-0@lo:38: 00010000:00080000:1.0:1789518053.655561:0:8781:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1789518053.655593:0:8781:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8d0fd67942314101 00000004:00100000:1.0:1789518053.655611:0:8781:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789518053.655641:0:8781:0:(import.c:65:import_set_state_nolock()) ffff8e73030cd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518053.655682:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876445522598272:12345-0@lo:38: Request processed in 141us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518053.655688:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789518053.655722:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965f80 x1876445522598400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518053.655735:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522598400:0@lo:400: 00010000:00080000:1.0:1789518053.655746:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965180 x1876445522598528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518053.655767:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522598528:0@lo:400: 00010000:00080000:1.0:1789518053.655801:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435f09500 x1876445522598272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518053.655808:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518053.655814:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789518053.655821:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518053.655825:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518053.655828:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518053.655833:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522598272:0@lo:38: 00000100:00100000:0.0:1789518053.656068:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522598656:0@lo:400: 00000100:00100000:0.0:1789518053.656101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518053.656131:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518053.656137:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522598784:0@lo:400: 00000100:00100000:0.0:1789518053.656170:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518053.656199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598656 00000100:00100000:0.0:1789518053.656204:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598656 00000100:00100000:0.0:1789518053.656233:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598784 00000100:00100000:0.0:1789518053.656236:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598784 00000100:00100000:0.0:1789518053.656253:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518053.656260:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522598656:12345-0@lo:400: 00000100:00100000:0.0:1789518053.656295:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522598656:12345-0@lo:400: Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.656301:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518053.656314:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518053.656319:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522598784:12345-0@lo:400: 00000100:00100000:0.0:1789518053.656344:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522598784:12345-0@lo:400: Request processed in 25us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.656350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789518053.656364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518053.656368:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789518053.656385:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301965880 x1876445522598784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518053.656395:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522598784:0@lo:400: 00010000:00080000:0.0:1789518053.656404:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301964e00 x1876445522598656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518053.656427:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522598656:0@lo:400: 00000020:01000004:0.0:1789518053.656578:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789518053.657714:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8e7303203380) 00000020:00000080:0.0:1789518053.657750:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:2.0:1789518053.658088:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522598912 00000100:00100000:2.0:1789518053.658108:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522598912 00000100:00100000:2.0:1789518053.658191:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518053.658200:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522598912:12345-0@lo:400: 00000100:00100000:2.0:1789518053.658277:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522598912:12345-0@lo:400: Request processed in 78us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.658284:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789518053.658342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789518053.658379:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7301967800 x1876445522598912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518053.658394:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522598912:0@lo:400: 00000020:01000004:0.0:1789518053.658610:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e730205a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789518053.658616:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e730205a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789518053.658619:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e730205a000 3 00010000:00080000:0.0:1789518053.658651:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e730292c800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.143@tcp at head 00000100:00100000:1.0:1789518053.661403:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1876445522599040:0@lo:901: 00000100:00100000:1.0:1789518053.661494:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.661530:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518053.661595:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599040 00000100:00100000:2.0:1789518053.661603:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599040 00000100:00100000:2.0:1789518053.661665:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518053.661673:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1876445522599040:12345-0@lo:901: 00000100:00100000:2.0:1789518053.661761:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1876445522599040:12345-0@lo:901: Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518053.661768:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789518053.663011:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789518053.663079:0:9523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e74317c0000 x1876445522599040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789518069 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518053.663094:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1876445522599040:0@lo:901: 00010000:00010000:0.0:1789518053.667335:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1789518053.667587:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789518053.667641:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789518053.667656:0:9522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8d0fd6794231410f 00000100:00080000:0.0:1789518053.667668:0:9522:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518053.667680:0:9522:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e730292c800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518053.667720:0:9522:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7302834700 x1876445522599168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518053.667744:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789518053.668085:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1876445522599168:0@lo:38: 00000100:00100000:1.0:1789518053.668168:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518053.669231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599168 00000100:00100000:0.0:1789518053.669244:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599168 00000100:00100000:0.0:1789518053.669327:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518053.669336:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1876445522599168:12345-0@lo:38: 00010000:00080000:0.0:1789518053.669369:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1789518053.669407:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8d0fd67942314116 00000004:00100000:0.0:1789518053.669425:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518053.669494:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8e730292e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518053.669576:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876445522599168:12345-0@lo:38: Request processed in 239us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.669589:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789518053.674829:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7302834700 x1876445522599168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518053.674866:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518053.674878:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789518053.674888:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518053.674905:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789518053.674909:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e730292c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518053.674917:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1876445522599168:0@lo:38: 00000040:00080000:1.0:1789518053.676728:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789518053.678447:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789518053.678530:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518053.678549:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.678563:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789518053.678617:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789518053.678620:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789518053.678622:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518053.678624:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518053.678625:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518053.678627:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518053.678629:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518053.678630:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518053.678632:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518053.678634:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518053.678635:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518053.678639:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789518053.678641:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518053.678643:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789518053.678644:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518053.678645:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518053.678646:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518053.678647:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518053.678649:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518053.678650:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518053.678651:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518053.678652:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518053.678653:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518053.678684:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789518053.678703:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522599296:0@lo:253: 00000100:00100000:0.0:1789518053.678775:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518053.678844:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518053.678874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599296 00000100:00100000:0.0:1789518053.678881:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599296 00000100:00100000:0.0:1789518053.679392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789518053.679403:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9505:x1876445522599296:12345-0@lo:253: 20000000:01000000:0.0:1789518053.679434:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789518053.679451:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789518053.688695:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789518053.688721:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789518053.688834:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518053.688848:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518053.688881:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.688909:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314044 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.688919:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231408a expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.688927:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.688970:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd6794231408a expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.688984:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd6794231408a expref: 17 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.688999:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522599424:0@lo:104: 00000100:00100000:1.0:1789518053.689074:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518053.689130:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314044 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.689153:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314044 expref: 17 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.689162:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522599552:0@lo:104: 00000100:00100000:1.0:1789518053.689185:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518053.689207:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518053.689327:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599424 00000100:00100000:0.0:1789518053.689335:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599424 00000100:00100000:0.0:1789518053.689370:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599552 00000100:00100000:0.0:1789518053.689373:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599552 00000100:00100000:0.0:1789518053.689386:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518053.689396:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6529:x1876445522599424:12345-0@lo:104: 00010000:00010000:0.0:1789518053.689410:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.689495:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518053.689502:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:6529:x1876445522599424:12345-0@lo:104: Request processed in 108us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.689510:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518053.689527:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518053.689533:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522599552:12345-0@lo:104: 00010000:00010000:0.0:1789518053.689541:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518053.689572:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518053.689578:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:6529:x1876445522599552:12345-0@lo:104: Request processed in 45us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.689591:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789518053.689733:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518053.689741:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689750:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.689754:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689763:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.689782:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.689787:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518053.689827:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689846:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518053.689866:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689873:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400030000/0x8d0fd6794231408a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314091 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689887:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518053.689900:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689906:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcea00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518053.689910:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689918:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518053.689925:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518053.689931:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518053.689951:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689957:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518053.689971:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689979:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcea00/0x8d0fd67942314044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231404b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.689992:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.689994:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.689996:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518053.690002:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518053.690013:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522599680:0@lo:103: 00000100:00100000:3.0:1789518053.690044:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.690078:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522599808:0@lo:103: 00000100:00100000:3.0:1789518053.690099:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518053.690126:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599680 00000100:00100000:3.0:1789518053.690131:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599680 00010000:00010000:3.0:1789518053.690163:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231408a expref: 18 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518053.690187:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599808 00000100:00100000:3.0:1789518053.690190:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599808 00010000:00010000:3.0:1789518053.690200:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314044 expref: 19 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518053.690216:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518053.690222:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3638:x1876445522599680:12345-0@lo:103: 00010000:00010000:3.0:1789518053.690242:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518053.690248:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231408a expref: 19 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690259:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd6794231408a expref: 19 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690273:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518053.690302:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3638:x1876445522599680:12345-0@lo:103: Request processed in 80us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.690309:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518053.690326:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518053.690332:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3639:x1876445522599808:12345-0@lo:103: 00010000:00010000:3.0:1789518053.690340:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518053.690345:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314044 expref: 18 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690354:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314044 expref: 18 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690367:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690376:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789518053.690392:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003438936s 00010000:00010000:3.0:1789518053.690397:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690415:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690424:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690432:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690437:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518053.690442:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690450:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690459:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518053.690500:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518053.690528:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3639:x1876445522599808:12345-0@lo:103: Request processed in 196us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518053.690535:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518053.690574:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522599808:0@lo:103: 00000100:00100000:3.0:1789518053.690600:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522599680:0@lo:103: 00010000:00010000:1.0:1789518053.691190:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030e00/0x8d0fd67942314091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd6794231408a expref: 17 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.691205:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522599424:0@lo:104: 00010000:00010000:1.0:1789518053.691217:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231404b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314044 expref: 16 pid: 6506 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518053.691225:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1876445522599552:0@lo:104: 00010000:00010000:1.0:1789518053.691257:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.691267:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.691273:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518053.691279:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0c600/0x8d0fd6794231411d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518053.691617:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:9505:x1876445522599296:12345-0@lo:253: Request processed in 12214us (12839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518053.691626:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789518053.692318:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9505:1876445522599296:0@lo:253: 10000000:01000000:3.0:1789518053.692334:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789518053.692345:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518053.692348:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518053.692349:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518053.692350:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518053.692352:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518053.692353:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518053.692354:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518053.692356:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789518053.692357:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789518053.692359:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518053.692360:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789518053.692374:0:9505:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789518053.704148:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789518053.704322:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789518053.704553:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789518053.704710:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789518053.707117:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789518053.707633:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789518053.709203:0:9505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789518053.725062:0:9505:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789518053.725073:0:9505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789518053.725118:0:9505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789518053.725174:0:9505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789518053.725195:0:9505:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789518053.725229:0:9505:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789518053.730645:0:9505:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789518053.730877:0:9505:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789518054.453650:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789518054.661314:0:9578:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789518054.661879:0:9578:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518055.479039:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518055.927897:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522599936:0@lo:13: 00000100:00100000:3.0:1789518055.927976:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518055.928108:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522599936 00000100:00100000:1.0:1789518055.928129:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522599936 00000100:00100000:1.0:1789518055.928192:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518055.928202:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522599936:12345-0@lo:13: 00002000:00000024:1.0:1789518055.928233:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789518055.928354:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518055.934761:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522599936:12345-0@lo:13: Request processed in 6548us (6772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518055.934778:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789518055.935305:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302834700 x1876445522599936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518055.935333:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522599936:0@lo:13: 00010000:00010000:3.0:1789518056.501689:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518057.525612:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518058.486503:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522600064:0@lo:41: 00000100:00100000:2.0:1789518058.486568:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518058.487455:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518058.487484:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522600320:0@lo:41: 00000100:00100000:0.0:1789518058.487526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518058.487564:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600064 00000100:00100000:0.0:1789518058.487572:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600064 00000100:00100000:0.0:1789518058.487605:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600320 00000100:00100000:0.0:1789518058.487607:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600320 00000100:00100000:0.0:1789518058.487619:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518058.487628:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522600064:12345-0@lo:41: 00000004:00000024:0.0:1789518058.487661:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789518058.488861:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522600192:0@lo:13: 00000100:00100000:3.0:1789518058.488907:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518058.489440:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522600064:12345-0@lo:41: Request processed in 1810us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.489453:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518058.489504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518058.489517:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522600320:12345-0@lo:41: 00000004:00000024:0.0:1789518058.489549:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789518058.489601:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522600320:12345-0@lo:41: Request processed in 88us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.489606:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518058.489754:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522600320:0@lo:41: 00000100:00100000:2.0:1789518058.491381:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522600064:0@lo:41: 00000100:00100000:2.0:1789518058.491424:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600192 00000100:00100000:2.0:1789518058.491432:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600192 00000100:00100000:2.0:1789518058.491717:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518058.491728:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522600192:12345-0@lo:13: 00002000:00000024:2.0:1789518058.491759:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518058.491976:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522600192:12345-0@lo:13: Request processed in 249us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.491994:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789518058.498422:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518058.498553:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302abaa00 x1876445522600192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518058.498596:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522600192:0@lo:13: 00010000:00010000:3.0:1789518058.549596:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518059.008286:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522600448:0@lo:400: 00000100:00100000:1.0:1789518059.008365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008422:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522600960:0@lo:400: 00000100:00100000:1.0:1789518059.008450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008503:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789518059.008509:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522600832:0@lo:400: 00000100:00100000:1.0:1789518059.008531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008550:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522601344:0@lo:400: 00000100:00100000:1.0:1789518059.008566:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008592:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522600704:0@lo:400: 00000100:00100000:1.0:1789518059.008615:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008634:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522601216:0@lo:400: 00000100:00100000:1.0:1789518059.008653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008663:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789518059.008679:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522600576:0@lo:400: 00000100:00100000:1.0:1789518059.008703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008714:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522601088:0@lo:400: 00000100:00100000:1.0:1789518059.008733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518059.008813:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600448 00000100:00100000:1.0:1789518059.008821:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600448 00000100:00100000:1.0:1789518059.008865:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789518059.008874:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3640:x1876445522600448:12345-0@lo:400: 00000100:00100000:1.0:1789518059.008926:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3640:x1876445522600448:12345-0@lo:400: Request processed in 53us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.008935:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789518059.008967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600960 00000100:00100000:1.0:1789518059.008970:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600960 00000100:00100000:1.0:1789518059.008997:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600832 00000100:00100000:1.0:1789518059.008999:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600832 00000100:00100000:1.0:1789518059.009009:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601344 00000100:00100000:1.0:1789518059.009011:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601344 00000100:00100000:1.0:1789518059.009020:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600704 00000100:00100000:1.0:1789518059.009022:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600704 00000100:00100000:1.0:1789518059.009031:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601216 00000100:00100000:1.0:1789518059.009033:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601216 00000100:00100000:1.0:1789518059.009042:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522600576 00000100:00100000:1.0:1789518059.009044:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522600576 00000100:00100000:1.0:1789518059.009055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518059.009060:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522600960:12345-0@lo:400: 00000100:00100000:1.0:1789518059.009101:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522600960:12345-0@lo:400: Request processed in 28us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.009108:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518059.009121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518059.009133:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522600832:12345-0@lo:400: 00000100:00100000:1.0:1789518059.009163:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522600832:12345-0@lo:400: Request processed in 31us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.009169:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518059.009181:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518059.009188:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522601344:12345-0@lo:400: 00000100:00100000:1.0:1789518059.009213:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522601344:12345-0@lo:400: Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.009218:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518059.009229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518059.009235:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522600704:12345-0@lo:400: 00000100:00100000:1.0:1789518059.009264:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522600704:12345-0@lo:400: Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.009270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518059.009281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518059.009287:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522601216:12345-0@lo:400: 00000100:00100000:1.0:1789518059.009312:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522601216:12345-0@lo:400: Request processed in 25us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.009317:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518059.009326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789518059.009332:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522600576:12345-0@lo:400: 00000100:00100000:1.0:1789518059.009488:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522600576:12345-0@lo:400: Request processed in 156us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.009494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789518059.009520:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601088 00000100:00100000:1.0:1789518059.009524:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601088 00000100:00100000:1.0:1789518059.009559:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518059.009566:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522601088:12345-0@lo:400: 00000100:00100000:1.0:1789518059.009598:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522601088:12345-0@lo:400: Request processed in 33us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518059.009603:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789518059.009644:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033d8380 x1876445522600832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518059.009659:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522600832:0@lo:400: 00010000:00080000:1.0:1789518059.009671:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033db480 x1876445522601344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518059.009679:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522601344:0@lo:400: 00000100:00100000:1.0:1789518059.009688:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522600448:0@lo:400: 00010000:00080000:1.0:1789518059.009697:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033db800 x1876445522600960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518059.009706:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522600960:0@lo:400: 00000100:00080000:1.0:1789518059.009733:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518059.009737:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518059.009739:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789518059.009752:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301965880 x1876445522600576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518059.009761:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522600576:0@lo:400: 00010000:00080000:1.0:1789518059.009771:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033daa00 x1876445522601088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518059.009779:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522601088:0@lo:400: 00010000:00080000:1.0:1789518059.009798:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033d9180 x1876445522600704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518059.009805:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522600704:0@lo:400: 00010000:00080000:1.0:1789518059.009815:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033dad80 x1876445522601216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518059.009822:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522601216:0@lo:400: 00010000:00010000:3.0:1789518059.574108:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518060.224508:0:9868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789518060.597727:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518061.047858:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522601472:0@lo:13: 00000100:00100000:1.0:1789518061.047934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518061.048319:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601472 00000100:00100000:3.0:1789518061.048330:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601472 00000100:00100000:3.0:1789518061.048405:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518061.048416:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522601472:12345-0@lo:13: 00002000:00000024:3.0:1789518061.048453:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518061.048515:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522601472:12345-0@lo:13: Request processed in 103us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518061.048521:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789518061.048565:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480ce00 x1876445522601472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518061.048580:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522601472:0@lo:13: 00000100:00080000:1.0:1789518061.048635:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1789518061.141643:0:9920:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518061.142331:0:9920:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518061.626967:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518062.581924:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789518062.581932:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7435dc1800 from 39 10000000:01000000:0.0:1789518062.581938:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518062.581988:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.582001:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.582013:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518062.582038:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522601600:0@lo:101: 00000100:00100000:0.0:1789518062.582127:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.582207:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.582456:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601600 00000100:00100000:2.0:1789518062.582501:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601600 00000100:00100000:2.0:1789518062.582557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789518062.582567:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522601600:12345-0@lo:101: 00010000:00010000:2.0:1789518062.582583:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518062.582596:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314124 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.582623:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314124 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.582634:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314124 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.582644:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dce400, rc 0) 00000100:00100000:2.0:1789518062.582694:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522601600:12345-0@lo:101: Request processed in 129us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.582700:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789518062.583439:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522601600:0@lo:101: 00010000:00010000:0.0:1789518062.583497:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.583509:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518062.583587:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522601728:0@lo:501: 00000100:00100000:0.0:1789518062.583627:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.583666:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.583752:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601728 00000100:00100000:1.0:1789518062.583759:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601728 00000100:00100000:1.0:1789518062.583800:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789518062.583810:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522601728:12345-0@lo:501: 00000100:00100000:1.0:1789518062.583963:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522601728:12345-0@lo:501: Request processed in 154us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.583970:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789518062.584210:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522601728:0@lo:501: 00000100:00100000:0.0:1789518062.584256:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522601856:0@lo:503: 00000100:00100000:0.0:1789518062.584295:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.584317:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.585283:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601856 00000100:00100000:1.0:1789518062.585296:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601856 00000100:00100000:1.0:1789518062.585358:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789518062.585367:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522601856:12345-0@lo:503: 00000100:00100000:1.0:1789518062.585542:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522601856:12345-0@lo:503: Request processed in 175us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.585550:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789518062.589259:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522601856:0@lo:503: 00000100:00100000:2.0:1789518062.596279:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9972:1876445522601984:0@lo:502: 00000100:00100000:2.0:1789518062.596376:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.596436:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74053dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.598066:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522601984 00000100:00100000:1.0:1789518062.598095:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522601984 00000100:00100000:1.0:1789518062.598162:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789518062.598173:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9972:x1876445522601984:12345-0@lo:502: 00000100:00100000:1.0:1789518062.598349:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9972:x1876445522601984:12345-0@lo:502: Request processed in 178us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.598357:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789518062.598508:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9972:1876445522601984:0@lo:502: 00000100:00100000:2.0:1789518062.598572:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9972:1876445522602112:0@lo:502: 00000100:00100000:2.0:1789518062.598608:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.598655:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74053dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.598723:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522602112 00000100:00100000:0.0:1789518062.598728:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522602112 00000100:00100000:0.0:1789518062.598761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789518062.598769:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9972:x1876445522602112:12345-0@lo:502: 00000100:00100000:0.0:1789518062.598876:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:9972:x1876445522602112:12345-0@lo:502: Request processed in 108us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.598882:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518062.599205:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9972:1876445522602112:0@lo:502: 00000040:00080000:2.0:1789518062.599224:0:9972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789518062.599750:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789518062.599776:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518062.599787:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.599798:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518062.599817:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789518062.599819:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789518062.599822:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789518062.599851:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.599860:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.599889:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518062.599906:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602240:0@lo:101: 00000100:00100000:0.0:1789518062.599944:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.599980:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.600097:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522602240 00000100:00100000:2.0:1789518062.600104:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522602240 00000100:00100000:2.0:1789518062.600140:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789518062.600147:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522602240:12345-0@lo:101: 00010000:00010000:2.0:1789518062.600157:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518062.600169:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314132 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.600191:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314132 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.600202:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314132 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.600210:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcfe00, rc 0) 00000100:00100000:2.0:1789518062.600245:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522602240:12345-0@lo:101: Request processed in 99us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.600252:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789518062.600422:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602240:0@lo:101: 00010000:00010000:0.0:1789518062.600436:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.600445:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518062.600528:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602368:0@lo:501: 00000100:00100000:0.0:1789518062.600553:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.600577:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518062.600634:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522602368 00000100:00100000:3.0:1789518062.600639:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522602368 00000100:00100000:3.0:1789518062.600667:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789518062.600674:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522602368:12345-0@lo:501: 00000100:00100000:3.0:1789518062.600794:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522602368:12345-0@lo:501: Request processed in 120us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.600813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789518062.601067:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602368:0@lo:501: 00000100:00100000:0.0:1789518062.601096:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602496:0@lo:503: 00000100:00100000:0.0:1789518062.601135:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.601160:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.601221:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522602496 00000100:00100000:1.0:1789518062.601227:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522602496 00000100:00100000:1.0:1789518062.601257:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789518062.601264:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522602496:12345-0@lo:503: 00000100:00100000:1.0:1789518062.601343:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522602496:12345-0@lo:503: Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.601350:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789518062.601650:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602496:0@lo:503: 00000100:00100000:3.0:1789518062.602162:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9973:1876445522602624:0@lo:502: 00000100:00100000:3.0:1789518062.602201:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.602228:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fda480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.602277:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522602624 00000100:00100000:2.0:1789518062.602284:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522602624 00000100:00100000:2.0:1789518062.602318:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789518062.602325:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9973:x1876445522602624:12345-0@lo:502: 00000100:00100000:2.0:1789518062.602416:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9973:x1876445522602624:12345-0@lo:502: Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.602423:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789518062.602588:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9973:1876445522602624:0@lo:502: 00000020:01000000:3.0:1789518062.602619:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518062.602628:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518062.602630:0:9973:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518062.602634:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518062.602636:0:9973:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789518062.602650:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9973:1876445522602752:0@lo:502: 00000100:00100000:3.0:1789518062.602680:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.602709:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fda480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.602790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522602752 00000100:00100000:0.0:1789518062.602796:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522602752 00000100:00100000:0.0:1789518062.602836:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789518062.602843:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9973:x1876445522602752:12345-0@lo:502: 00000100:00100000:0.0:1789518062.602933:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:9973:x1876445522602752:12345-0@lo:502: Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.602940:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789518062.603093:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9973:1876445522602752:0@lo:502: 00000020:01000000:3.0:1789518062.603111:0:9973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518062.603116:0:9973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518062.603117:0:9973:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789518062.603120:0:9973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789518062.604720:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789518062.604766:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789518062.604777:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.604791:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518062.604812:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789518062.604814:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e74044cd800 from 39 10000000:01000000:0.0:1789518062.604818:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518062.604858:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.604875:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.604887:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518062.604908:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602880:0@lo:101: 00000100:00100000:0.0:1789518062.604966:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.605011:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fb3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518062.605179:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522602880 00000100:00100000:3.0:1789518062.605189:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522602880 00000100:00100000:3.0:1789518062.605230:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789518062.605239:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522602880:12345-0@lo:101: 00010000:00010000:3.0:1789518062.605252:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518062.605266:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314140 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.605290:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314140 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.605301:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314140 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.605309:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166c400, rc 0) 00000100:00100000:3.0:1789518062.605358:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522602880:12345-0@lo:101: Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.605376:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789518062.605667:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522602880:0@lo:101: 00010000:00010000:1.0:1789518062.605684:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518062.605692:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518062.605759:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603008:0@lo:501: 00000100:00100000:1.0:1789518062.605788:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.605807:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.608631:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603008 00000100:00100000:0.0:1789518062.608648:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603008 00000100:00100000:0.0:1789518062.608721:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789518062.608732:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522603008:12345-0@lo:501: 00000100:00100000:0.0:1789518062.608951:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522603008:12345-0@lo:501: Request processed in 221us (3161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.608959:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789518062.609521:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603008:0@lo:501: 00000100:00100000:1.0:1789518062.609572:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603136:0@lo:503: 00000100:00100000:1.0:1789518062.609627:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.609660:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.609800:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603136 00000100:00100000:0.0:1789518062.609814:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603136 00000100:00100000:0.0:1789518062.609849:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518062.609857:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522603136:12345-0@lo:503: 00000100:00100000:0.0:1789518062.609964:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522603136:12345-0@lo:503: Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.609971:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789518062.610111:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603136:0@lo:503: 00000100:00100000:1.0:1789518062.610691:0:9974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9974:1876445522603264:0@lo:502: 00000100:00100000:1.0:1789518062.610750:0:9974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.610777:0:9974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518062.610907:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603264 00000100:00100000:3.0:1789518062.610913:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603264 00000100:00100000:3.0:1789518062.610954:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789518062.610962:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:9974:x1876445522603264:12345-0@lo:502: 00000100:00100000:3.0:1789518062.611053:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:9974:x1876445522603264:12345-0@lo:502: Request processed in 92us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.611073:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789518062.611391:0:9974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9974:1876445522603264:0@lo:502: 00000100:00100000:1.0:1789518062.611443:0:9974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9974:1876445522603392:0@lo:502: 00000100:00100000:1.0:1789518062.611519:0:9974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.611536:0:9974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518062.611625:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603392 00000100:00100000:3.0:1789518062.611630:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603392 00000100:00100000:3.0:1789518062.611662:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789518062.611668:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:9974:x1876445522603392:12345-0@lo:502: 00000100:00100000:3.0:1789518062.611759:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:9974:x1876445522603392:12345-0@lo:502: Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.611765:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518062.611840:0:9974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9974:1876445522603392:0@lo:502: 00000040:00080000:0.0:1789518062.611859:0:9974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789518062.612183:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789518062.612203:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789518062.612214:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.612228:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518062.612238:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518062.612241:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e74044cd800 from 6 10000000:01000000:3.0:1789518062.612243:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518062.612272:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.612292:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.612303:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518062.612318:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603520:0@lo:101: 00000100:00100000:3.0:1789518062.612353:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.612390:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fdac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.612438:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603520 00000100:00100000:0.0:1789518062.612442:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603520 00000100:00100000:0.0:1789518062.612509:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789518062.612517:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522603520:12345-0@lo:101: 00010000:00010000:0.0:1789518062.612527:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518062.612541:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9c000/0x8d0fd67942314155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231414e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.612562:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9c000/0x8d0fd67942314155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231414e expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.612574:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9c000/0x8d0fd67942314155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231414e expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.612583:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c000, rc 0) 00000100:00100000:0.0:1789518062.612625:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522603520:12345-0@lo:101: Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.612631:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789518062.614212:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603520:0@lo:101: 00010000:00010000:3.0:1789518062.614240:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.614252:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518062.614325:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603648:0@lo:256: 00000100:00100000:3.0:1789518062.614382:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.614411:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fdac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.614858:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603648 00000100:00100000:0.0:1789518062.614877:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603648 00000100:00100000:0.0:1789518062.614924:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789518062.614934:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522603648:12345-0@lo:256: 20000000:01000000:0.0:1789518062.614956:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518062.614978:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518062.614981:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789518062.615087:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522603648:12345-0@lo:256: Request processed in 155us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.615095:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789518062.615436:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603648:0@lo:256: 10000000:01000000:3.0:1789518062.615541:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518062.615549:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.615559:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518062.615578:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789518062.615580:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789518062.615583:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789518062.615609:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.615617:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.615626:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518062.615641:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603776:0@lo:101: 00000100:00100000:3.0:1789518062.615673:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.615701:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406de4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.616531:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603776 00000100:00100000:0.0:1789518062.616551:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603776 00000100:00100000:0.0:1789518062.616603:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789518062.616612:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522603776:12345-0@lo:101: 00010000:00010000:0.0:1789518062.616627:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518062.616643:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231415c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.616666:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231415c expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.616676:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231415c expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.616685:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9cc00, rc 0) 00000100:00100000:0.0:1789518062.616745:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522603776:12345-0@lo:101: Request processed in 135us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.616761:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789518062.619400:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603776:0@lo:101: 00010000:00010000:3.0:1789518062.619430:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.619444:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518062.619562:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603904:0@lo:501: 00000100:00100000:3.0:1789518062.619625:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.619664:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406de4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.620370:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522603904 00000100:00100000:0.0:1789518062.620381:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522603904 00000100:00100000:0.0:1789518062.620445:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789518062.620455:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522603904:12345-0@lo:501: 00000100:00100000:0.0:1789518062.620653:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522603904:12345-0@lo:501: Request processed in 200us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.620661:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789518062.622659:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522603904:0@lo:501: 00000100:00100000:3.0:1789518062.622735:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522604032:0@lo:503: 00000100:00100000:3.0:1789518062.622835:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.623036:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406de4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.623149:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604032 00000100:00100000:1.0:1789518062.623157:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604032 00000100:00100000:1.0:1789518062.623205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789518062.623215:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522604032:12345-0@lo:503: 00000100:00100000:1.0:1789518062.623350:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522604032:12345-0@lo:503: Request processed in 136us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.623358:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789518062.624561:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522604032:0@lo:503: 00000100:00100000:2.0:1789518062.625196:0:9975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9975:1876445522604160:0@lo:502: 00000100:00100000:2.0:1789518062.625271:0:9975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.625307:0:9975:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74395c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.625502:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604160 00000100:00100000:1.0:1789518062.625509:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604160 00000100:00100000:1.0:1789518062.625556:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789518062.625566:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:9975:x1876445522604160:12345-0@lo:502: 00000100:00100000:1.0:1789518062.625694:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:9975:x1876445522604160:12345-0@lo:502: Request processed in 128us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.625701:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789518062.626647:0:9975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9975:1876445522604160:0@lo:502: 00000020:01000000:2.0:1789518062.626690:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789518062.626698:0:9975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789518062.626706:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518062.626707:0:9975:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789518062.626715:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789518062.626719:0:9975:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:2.0:1789518062.626758:0:9975:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789518062.626762:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518062.626779:0:9975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e73030eb380) 00000020:00000080:2.0:1789518062.626815:0:9975:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789518062.626822:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789518062.627107:0:9975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789518062.627115:0:9975:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789518062.627129:0:9975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942314171 00010000:00080000:2.0:1789518062.627167:0:9975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7303456800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518062.628979:0:9975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789518062.629127:0:9975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789518062.629140:0:9975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789518062.629452:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518062.629677:0:9975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518062.630048:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789518062.630158:0:9975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789518062.631168:0:9976:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518062.631174:0:9976:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789518062.637994:0:9975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789518062.638011:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789518062.638073:0:9975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789518062.638101:0:9975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd67942314178 00000100:00080000:3.0:1789518062.638112:0:9975:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518062.638124:0:9975:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7303456800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518062.638168:0:9975:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7302aba300 x1876445522604288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518062.638194:0:9975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789518062.638294:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522604288:0@lo:8: 00000100:00100000:1.0:1789518062.638378:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.638713:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604288 00000100:00100000:3.0:1789518062.638721:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604288 00000100:00100000:3.0:1789518062.638756:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518062.638764:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522604288:12345-0@lo:8: 00010000:00080000:3.0:1789518062.638796:0:8428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:3.0:1789518062.638838:0:8428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd6794231417f 00002000:00100000:3.0:1789518062.638855:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e73034e0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789518062.638949:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789518062.638960:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789518062.639035:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789518062.639279:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789518062.639505:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8e73034e3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518062.639596:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876445522604288:12345-0@lo:8: Request processed in 831us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.639604:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789518062.639668:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302aba300 x1876445522604288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518062.639680:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518062.639689:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789518062.639697:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789518062.639705:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789518062.639707:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7303456800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789518062.639716:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789518062.639721:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522604288:0@lo:8: 00000004:00080000:1.0:1789518062.640098:0:9976:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789518062.640169:0:9976:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 230425703932ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789518062.640176:0:9976:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:3.0:1789518062.640294:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518062.640301:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518062.640303:0:9975:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789518062.640307:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518062.640311:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518062.640312:0:9975:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518062.640315:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518062.640317:0:9975:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789518062.640355:0:9975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9975:1876445522604416:0@lo:502: 00000100:00100000:3.0:1789518062.640416:0:9975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.640460:0:9975:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fda840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.640681:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604416 00000100:00100000:2.0:1789518062.640689:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604416 00000100:00100000:2.0:1789518062.640742:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789518062.640752:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:9975:x1876445522604416:12345-0@lo:502: 00000100:00100000:2.0:1789518062.640893:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:9975:x1876445522604416:12345-0@lo:502: Request processed in 142us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.640901:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789518062.642340:0:9975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9975:1876445522604416:0@lo:502: 00000020:01000000:3.0:1789518062.642409:0:9975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518062.642417:0:9975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518062.642419:0:9975:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789518062.642424:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1789518062.642852:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522604672:0@lo:400: 00000100:00100000:0.0:1789518062.642930:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.642966:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522605184:0@lo:400: 00000100:00100000:0.0:1789518062.642989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643008:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522605696:0@lo:400: 00000100:00100000:0.0:1789518062.643032:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643065:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789518062.643072:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522604544:0@lo:400: 00000100:00100000:0.0:1789518062.643092:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522605056:0@lo:400: 00000100:00100000:0.0:1789518062.643132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643149:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522605568:0@lo:400: 00000100:00100000:0.0:1789518062.643165:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643188:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522604800:0@lo:400: 00000100:00100000:0.0:1789518062.643206:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643215:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522605312:0@lo:400: 00000100:00100000:0.0:1789518062.643243:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643255:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789518062.643259:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522604928:0@lo:400: 00000100:00100000:0.0:1789518062.643275:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643301:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522605440:0@lo:400: 00000100:00100000:0.0:1789518062.643318:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.643347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604672 00000100:00100000:0.0:1789518062.643355:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604672 00000100:00100000:0.0:1789518062.643386:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604928 00000100:00100000:0.0:1789518062.643388:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604928 00000100:00100000:0.0:1789518062.643401:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518062.643409:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522604672:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643490:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522604672:12345-0@lo:400: Request processed in 55us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643497:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518062.643514:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518062.643519:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522604928:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643553:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522604928:12345-0@lo:400: Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643558:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518062.643574:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605184 00000100:00100000:0.0:1789518062.643577:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605184 00000100:00100000:0.0:1789518062.643607:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605696 00000100:00100000:0.0:1789518062.643610:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605696 00000100:00100000:0.0:1789518062.643620:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604544 00000100:00100000:0.0:1789518062.643622:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604544 00000100:00100000:0.0:1789518062.643630:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605568 00000100:00100000:0.0:1789518062.643633:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605568 00000100:00100000:0.0:1789518062.643642:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522604800 00000100:00100000:0.0:1789518062.643652:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522604800 00000100:00100000:0.0:1789518062.643666:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605312 00000100:00100000:0.0:1789518062.643668:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605312 00000100:00100000:0.0:1789518062.643681:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518062.643686:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522605184:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643717:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522605184:12345-0@lo:400: Request processed in 31us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643722:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518062.643733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518062.643738:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522605696:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643774:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522605696:12345-0@lo:400: Request processed in 36us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643779:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518062.643790:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518062.643796:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522604544:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643818:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522604544:12345-0@lo:400: Request processed in 22us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643823:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518062.643834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518062.643840:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522605568:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643863:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522605568:12345-0@lo:400: Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643868:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518062.643878:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518062.643882:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522604800:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643902:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522604800:12345-0@lo:400: Request processed in 20us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643914:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518062.643927:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518062.643932:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522605312:12345-0@lo:400: 00000100:00100000:0.0:1789518062.643960:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522605312:12345-0@lo:400: Request processed in 27us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.643966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518062.643991:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605056 00000100:00100000:0.0:1789518062.643995:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605056 00000100:00100000:0.0:1789518062.644021:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605440 00000100:00100000:0.0:1789518062.644024:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605440 00000100:00100000:0.0:1789518062.644035:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518062.644041:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522605056:12345-0@lo:400: 00000100:00100000:0.0:1789518062.644084:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522605056:12345-0@lo:400: Request processed in 43us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.644089:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518062.644101:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518062.644107:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522605440:12345-0@lo:400: 00000100:00100000:0.0:1789518062.644130:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522605440:12345-0@lo:400: Request processed in 25us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.644135:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789518062.644163:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518062.644167:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518062.644169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518062.644201:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522604928:0@lo:400: 00010000:00080000:0.0:1789518062.644215:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e0380 x1876445522605440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644237:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522605440:0@lo:400: 00010000:00080000:0.0:1789518062.644250:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480ce00 x1876445522604800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522604800:0@lo:400: 00010000:00080000:0.0:1789518062.644268:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e1180 x1876445522605312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644276:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522605312:0@lo:400: 00010000:00080000:0.0:1789518062.644314:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480dc00 x1876445522604544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644323:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522604544:0@lo:400: 00010000:00080000:0.0:1789518062.644331:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e0e00 x1876445522605056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644337:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522605056:0@lo:400: 00010000:00080000:0.0:1789518062.644346:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e3800 x1876445522605568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644352:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522605568:0@lo:400: 00000100:00100000:0.0:1789518062.644361:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522604672:0@lo:400: 00010000:00080000:0.0:1789518062.644371:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e0700 x1876445522605184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644378:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522605184:0@lo:400: 00010000:00080000:0.0:1789518062.644388:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e2a00 x1876445522605696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.644404:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522605696:0@lo:400: 00000020:01000000:2.0:1789518062.644885:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1789518062.644924:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789518062.644937:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.644955:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518062.644966:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789518062.644969:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7439644800 from 39 10000000:01000000:2.0:1789518062.644972:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518062.645007:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.645014:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.645025:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518062.645047:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522605824:0@lo:101: 00000100:00100000:2.0:1789518062.645106:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.645142:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605824 00000100:00100000:2.0:1789518062.645148:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605824 00000100:00100000:2.0:1789518062.645185:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789518062.645194:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522605824:12345-0@lo:101: 00010000:00010000:2.0:1789518062.645206:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518062.645219:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314186 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.645244:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314186 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.645257:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314186 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.645272:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcec00, rc 0) 00000100:00100000:2.0:1789518062.645300:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522605824:12345-0@lo:101: Request processed in 107us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.645306:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789518062.645351:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74395c9840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.645368:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522605824:0@lo:101: 00010000:00010000:2.0:1789518062.645383:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.645393:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518062.645444:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522605952:0@lo:501: 00000100:00100000:2.0:1789518062.645486:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.645509:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522605952 00000100:00100000:2.0:1789518062.645513:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522605952 00000100:00100000:2.0:1789518062.645535:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789518062.645541:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522605952:12345-0@lo:501: 00000100:00100000:2.0:1789518062.645661:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522605952:12345-0@lo:501: Request processed in 120us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.645668:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789518062.645691:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74395c9840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.645701:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522605952:0@lo:501: 00000100:00100000:2.0:1789518062.645725:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606080:0@lo:503: 00000100:00100000:2.0:1789518062.645760:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.645779:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.645796:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606080 00000100:00100000:2.0:1789518062.645799:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606080 00000100:00100000:2.0:1789518062.645817:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789518062.645823:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522606080:12345-0@lo:503: 00000100:00100000:2.0:1789518062.645899:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522606080:12345-0@lo:503: Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.645905:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789518062.645943:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606080:0@lo:503: 00000100:00100000:2.0:1789518062.646125:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9978:1876445522606208:0@lo:502: 00000100:00100000:2.0:1789518062.646154:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.646170:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606208 00000100:00100000:2.0:1789518062.646173:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606208 00000100:00100000:2.0:1789518062.646190:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789518062.646195:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:9978:x1876445522606208:12345-0@lo:502: 00000100:00100000:2.0:1789518062.646258:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:9978:x1876445522606208:12345-0@lo:502: Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.646264:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789518062.646288:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.646298:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9978:1876445522606208:0@lo:502: 00000100:00100000:2.0:1789518062.646331:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9978:1876445522606336:0@lo:502: 00000100:00100000:2.0:1789518062.646356:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.646370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606336 00000100:00100000:2.0:1789518062.646373:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606336 00000100:00100000:2.0:1789518062.646389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789518062.646394:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:9978:x1876445522606336:12345-0@lo:502: 00000100:00100000:2.0:1789518062.646445:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:9978:x1876445522606336:12345-0@lo:502: Request processed in 51us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.646451:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789518062.646496:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.646506:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9978:1876445522606336:0@lo:502: 00000040:00080000:2.0:1789518062.646522:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789518062.646569:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789518062.646584:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518062.646590:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.646600:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518062.646609:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789518062.646611:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7439644800 from 6 10000000:01000000:2.0:1789518062.646614:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789518062.646633:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.646639:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.646648:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518062.646658:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606464:0@lo:101: 00000100:00100000:2.0:1789518062.646679:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.646689:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.646706:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606464 00000100:00100000:2.0:1789518062.646709:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606464 00000100:00100000:2.0:1789518062.646725:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789518062.646730:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522606464:12345-0@lo:101: 00010000:00010000:2.0:1789518062.646737:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518062.646747:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dce800/0x8d0fd6794231419b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314194 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.646763:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dce800/0x8d0fd6794231419b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314194 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.646772:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dce800/0x8d0fd6794231419b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314194 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.646779:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dce800, rc 0) 00000100:00100000:2.0:1789518062.646802:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522606464:12345-0@lo:101: Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.646807:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789518062.646834:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606464:0@lo:101: 00010000:00010000:2.0:1789518062.646846:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.646854:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518062.646897:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606592:0@lo:256: 00000100:00100000:2.0:1789518062.646924:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.646936:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.646948:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606592 00000100:00100000:2.0:1789518062.646956:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606592 00000100:00100000:2.0:1789518062.646977:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789518062.646982:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522606592:12345-0@lo:256: 20000000:01000000:2.0:1789518062.646994:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789518062.647011:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789518062.647015:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789518062.647093:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522606592:12345-0@lo:256: Request processed in 111us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.647099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789518062.647125:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606592:0@lo:256: 10000000:01000000:2.0:1789518062.647164:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789518062.647169:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.647176:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518062.647182:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789518062.647184:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789518062.647186:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789518062.647199:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.647205:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.647212:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518062.647222:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606720:0@lo:101: 00000100:00100000:2.0:1789518062.647250:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.647261:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.647272:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606720 00000100:00100000:2.0:1789518062.647275:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606720 00000100:00100000:2.0:1789518062.647292:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789518062.647297:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522606720:12345-0@lo:101: 00010000:00010000:2.0:1789518062.647303:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518062.647310:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423141a2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.647324:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.647331:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.647337:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcea00, rc 0) 00000100:00100000:2.0:1789518062.647359:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522606720:12345-0@lo:101: Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.647365:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789518062.647390:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606720:0@lo:101: 00010000:00010000:2.0:1789518062.647398:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518062.647406:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518062.647443:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606848:0@lo:501: 00000100:00100000:2.0:1789518062.647497:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.647510:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.647522:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606848 00000100:00100000:2.0:1789518062.647526:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606848 00000100:00100000:2.0:1789518062.647545:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789518062.647551:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522606848:12345-0@lo:501: 00000100:00100000:2.0:1789518062.647643:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522606848:12345-0@lo:501: Request processed in 91us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.647648:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789518062.647673:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606848:0@lo:501: 00000100:00100000:2.0:1789518062.647694:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606976:0@lo:503: 00000100:00100000:2.0:1789518062.647731:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.647743:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.647755:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522606976 00000100:00100000:2.0:1789518062.647757:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522606976 00000100:00100000:2.0:1789518062.647776:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789518062.647782:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522606976:12345-0@lo:503: 00000100:00100000:2.0:1789518062.647858:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522606976:12345-0@lo:503: Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.647865:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789518062.647903:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522606976:0@lo:503: 00010000:00010000:3.0:1789518062.648900:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518062.649238:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522607104:0@lo:700: 00000100:00100000:1.0:1789518062.649290:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.649331:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522607104 00000100:00100000:1.0:1789518062.649338:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522607104 00000100:00100000:1.0:1789518062.649392:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518062.649400:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9977:x1876445522607104:12345-0@lo:700: 00000100:00100000:1.0:1789518062.649432:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1876445522607232:0@lo:700: 00000100:00100000:1.0:1789518062.649458:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.649502:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.649517:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518062.650408:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9979:1876445522607360:0@lo:502: 00000100:00100000:1.0:1789518062.650498:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.650531:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409ec83c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789518062.651174:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518062.651401:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522607360 00000100:00100000:3.0:1789518062.651411:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522607360 00000100:00100000:3.0:1789518062.651648:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789518062.651660:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:9979:x1876445522607360:12345-0@lo:502: 00000100:00100000:3.0:1789518062.651952:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:9979:x1876445522607360:12345-0@lo:502: Request processed in 293us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.651960:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789518062.652043:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9979:1876445522607360:0@lo:502: 00000020:01000000:3.0:1789518062.652087:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518062.652095:0:9979:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789518062.652102:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518062.652105:0:9979:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789518062.652109:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518062.652113:0:9979:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:3.0:1789518062.652139:0:9979:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789518062.652141:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518062.652167:0:9979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e73034fcd40) 00000020:00000080:3.0:1789518062.652193:0:9979:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789518062.652199:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518062.652289:0:9979:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789518062.652295:0:9979:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789518062.652302:0:9979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd679423141b7 00010000:00080000:3.0:1789518062.652334:0:9979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e73034e6000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518062.654318:0:9979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000100:00100000:0.0:1789518062.654733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522607232 00000100:00100000:0.0:1789518062.654745:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522607232 00000100:00100000:0.0:1789518062.654796:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518062.654808:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1876445522607232:12345-0@lo:700: 00000040:01000000:3.0:1789518062.655439:0:9979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789518062.655453:0:9979:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789518062.656081:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518062.656195:0:9979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518062.656350:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789518062.656438:0:9979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789518062.657695:0:9980:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518062.657702:0:9980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789518062.659628:0:9979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518062.659651:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789518062.659718:0:9979:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789518062.659747:0:9979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd679423141be 00000100:00080000:1.0:1789518062.659760:0:9979:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518062.659773:0:9979:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e73034e6000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518062.659830:0:9979:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033d9f80 x1876445522607488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518062.659934:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522607488:0@lo:8: 00000100:00100000:1.0:1789518062.660009:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518062.660146:0:9979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789518062.660214:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518062.660219:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518062.660221:0:9979:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789518062.660224:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518062.660228:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518062.660230:0:9979:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789518062.660232:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789518062.660234:0:9979:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789518062.660259:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9979:1876445522607616:0@lo:502: 00000100:00100000:1.0:1789518062.660301:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.660316:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409ec83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.660401:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522607616 00000100:00100000:2.0:1789518062.660410:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522607616 00000100:00100000:2.0:1789518062.660452:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789518062.660461:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:9979:x1876445522607616:12345-0@lo:502: 00000004:00080000:3.0:1789518062.660560:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789518062.661603:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522607488 00000100:00100000:0.0:1789518062.661610:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522607488 00000100:00100000:0.0:1789518062.661652:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518062.661673:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1876445522607488:12345-0@lo:8: 00010000:00080000:0.0:1789518062.661704:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1789518062.661736:0:8427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd679423141c5 00002000:00100000:0.0:1789518062.661752:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e7435e37000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789518062.661756:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789518062.661759:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789518062.662144:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:9979:x1876445522607616:12345-0@lo:502: Request processed in 1683us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.662160:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00002000:00080000:0.0:1789518062.664160:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789518062.664202:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8e7435e30800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518062.664301:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876445522607488:12345-0@lo:8: Request processed in 2638us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.664312:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789518062.664361:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033d9f80 x1876445522607488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518062.664374:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518062.664384:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789518062.664392:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789518062.664398:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789518062.664401:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73034e6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789518062.664424:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789518062.664430:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522607488:0@lo:8: 00000004:00080000:3.0:1789518062.664459:0:9980:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 40000000:02000000:2.0:1789518062.664507:0:6520:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:3.0:1789518062.664556:0:9980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 230450090720ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789518062.664563:0:9980:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789518062.665736:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:9979:1876445522607616:0@lo:502: 00000020:01000000:1.0:1789518062.665773:0:9979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518062.665780:0:9979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518062.665782:0:9979:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789518062.665785:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789518062.666130:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789518062.666155:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789518062.666167:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.666179:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518062.666190:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789518062.666200:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e740dd9cd40 from 1 10000000:01000000:3.0:1789518062.666204:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789518062.666243:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.666252:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.666262:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518062.666283:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522607744:0@lo:101: 00000100:00100000:3.0:1789518062.666345:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.666391:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.666754:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522607744 00000100:00100000:0.0:1789518062.666764:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522607744 00000100:00100000:0.0:1789518062.666821:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789518062.666833:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522607744:12345-0@lo:101: 00010000:00010000:0.0:1789518062.666847:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518062.666869:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423141cc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.666894:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423141cc expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.666906:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423141cc expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518062.666914:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9ca00, rc 0) 00000100:00100000:0.0:1789518062.666975:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522607744:12345-0@lo:101: Request processed in 145us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.666983:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789518062.667120:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522607744:0@lo:101: 00010000:00010000:3.0:1789518062.667137:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.667147:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518062.667211:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522607872:0@lo:501: 00000100:00100000:3.0:1789518062.667241:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.668011:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.668125:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522607872 00000100:00100000:0.0:1789518062.668133:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522607872 00000100:00100000:0.0:1789518062.668184:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789518062.668195:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522607872:12345-0@lo:501: 00000100:00100000:0.0:1789518062.668304:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522607872:12345-0@lo:501: Request processed in 112us (1061us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518062.668312:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789518062.668361:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522607872:0@lo:501: 10000000:01000000:3.0:1789518062.668394:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789518062.668402:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518062.668421:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518062.669126:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789518062.676674:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518062.676700:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522608000:0@lo:13: 00000100:00100000:2.0:1789518062.676799:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1876445522607232:12345-0@lo:700: Request processed in 21991us (27336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.676811:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789518062.676893:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033d8380 x1876445522607232/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518062.676907:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1876445522607232:0@lo:700: 40000000:02000000:2.0:1789518062.676922:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1789518062.677590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.677630:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608000 00000004:00080000:0.0:1789518062.677633:0:9981:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789518062.677639:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608000 00000100:00100000:0.0:1789518062.677662:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608128:0@lo:7: 00000100:00100000:0.0:1789518062.677698:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.677705:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518062.677718:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522608000:12345-0@lo:13: 00000100:00100000:0.0:1789518062.677727:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608128 00000100:00100000:0.0:1789518062.677732:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608128 00002000:00000024:3.0:1789518062.677749:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789518062.677771:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518062.677779:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:9981:x1876445522608128:12345-0@lo:7: 00000100:00100000:3.0:1789518062.677800:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876445522608000:12345-0@lo:13: Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.677807:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789518062.677826:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789518062.677853:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e2a00 x1876445522608000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518062.677871:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522608000:0@lo:13: 00000100:00100000:3.0:1789518062.682639:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fb3b40 going to sleep for 11 seconds 00000001:00100000:1.0:1789518062.694104:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789518062.694117:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789518062.694636:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9977:x1876445522607104:12345-0@lo:700: Request processed in 45231us (45340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518062.694653:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789518062.695017:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033db800 x1876445522607104/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518062.695034:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522607104:0@lo:700: 00002000:00080000:0.0:1789518062.697454:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789518062.697481:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789518062.697584:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9981:x1876445522608128:12345-0@lo:7: Request processed in 19801us (19881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518062.697595:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789518062.699087:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e3800 x1876445522608128/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518062.699109:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608128:0@lo:7: 00000004:00080000:3.0:1789518062.699126:0:9981:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789518062.699178:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608256:0@lo:5: 00000100:00100000:3.0:1789518062.699236:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.699286:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.699604:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608256 00000100:00100000:0.0:1789518062.699613:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608256 00000100:00100000:0.0:1789518062.699718:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518062.699738:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9981:x1876445522608256:12345-0@lo:5: 00002000:00080000:0.0:1789518062.699770:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789518062.699775:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789518062.700174:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9981:x1876445522608256:12345-0@lo:5: Request processed in 438us (937us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789518062.700182:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789518062.700254:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302aba300 x1876445522608256/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518062.700269:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608256:0@lo:5: 00000004:00080000:1.0:1789518062.700281:0:9981:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789518062.700318:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608384:0@lo:700: 00000100:00100000:1.0:1789518062.700368:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.700400:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409ec83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518062.700618:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608384 00000100:00100000:2.0:1789518062.700625:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608384 00000100:00100000:2.0:1789518062.700661:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518062.700670:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9981:x1876445522608384:12345-0@lo:700: 00000001:00080000:2.0:1789518062.706617:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1789518062.707038:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9981:x1876445522608384:12345-0@lo:700: Request processed in 6364us (6664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.707078:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789518062.710300:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033db800 x1876445522608384/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518062.710317:0:9981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789518062.710338:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608384:0@lo:700: 00000004:02000040:3.0:1789518062.714174:0:9981:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000004:00080000:0.0:1789518062.714996:0:9977:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789518062.715028:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522608640:0@lo:7: 00000100:00100000:0.0:1789518062.715122:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518062.715186:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fb3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.715209:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608640 00000100:00100000:0.0:1789518062.715218:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608640 00000100:00100000:0.0:1789518062.715277:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518062.715287:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9977:x1876445522608640:12345-0@lo:7: 00000100:00100000:1.0:1789518062.715838:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518062.715856:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522608512:0@lo:13: 00000100:00100000:1.0:1789518062.715899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518062.715941:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608512 00000100:00100000:1.0:1789518062.715945:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608512 00000100:00100000:1.0:1789518062.715975:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518062.715982:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876445522608512:12345-0@lo:13: 00002000:00000024:1.0:1789518062.715998:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789518062.716048:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1876445522608512:12345-0@lo:13: Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.716067:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789518062.716115:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e1180 x1876445522608512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518062.716189:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522608512:0@lo:13: 00000100:00100000:3.0:1789518062.720162:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608768:0@lo:5: 00000100:00100000:3.0:1789518062.720232:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.720276:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.720333:0:8427:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518062.720340:0:8427:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789518062.720407:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518062.720416:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608768 00000100:00100000:2.0:1789518062.720423:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608768 00000100:00100000:0.0:1789518062.721901:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518062.721918:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9981:x1876445522608768:12345-0@lo:5: 00002000:00080000:1.0:1789518062.725601:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789518062.725611:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789518062.725714:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9977:x1876445522608640:12345-0@lo:7: Request processed in 10424us (10588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.725736:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789518062.725938:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e0380 x1876445522608640/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518062.725963:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522608640:0@lo:7: 00000004:00080000:2.0:1789518062.725979:0:9977:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789518062.726025:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522608896:0@lo:5: 00000100:00100000:2.0:1789518062.726077:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.726117:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518062.726635:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522608896 00000100:00100000:3.0:1789518062.726644:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522608896 00000100:00100000:3.0:1789518062.726692:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518062.726702:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9977:x1876445522608896:12345-0@lo:5: 00002000:00080000:3.0:1789518062.726870:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789518062.726926:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9977:x1876445522608896:12345-0@lo:5: Request processed in 226us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.726934:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789518062.727012:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f08e00 x1876445522608896/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518062.727024:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522608896:0@lo:5: 00000004:00080000:2.0:1789518062.727034:0:9977:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789518062.727079:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522609024:0@lo:5: 00000100:00100000:2.0:1789518062.727104:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.727135:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518062.727192:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609024 00000100:00100000:3.0:1789518062.727197:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609024 00000100:00100000:3.0:1789518062.727227:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518062.727234:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9977:x1876445522609024:12345-0@lo:5: 00002000:00080000:3.0:1789518062.727262:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1789518062.732292:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9977:x1876445522609024:12345-0@lo:5: Request processed in 5050us (5178us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789518062.732307:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00080000:1.0:1789518062.733642:0:9982:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789518062.733664:0:9982:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1789518062.735159:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9981:x1876445522608768:12345-0@lo:5: Request processed in 13241us (14922us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789518062.735183:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789518062.735422:0:9981:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302ab8000 x1876445522608768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.735441:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9981:1876445522608768:0@lo:5: 00000004:00080000:0.0:1789518062.735458:0:9981:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00080000:2.0:1789518062.735654:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f08e00 x1876445522609024/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518062.735666:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9977:1876445522609024:0@lo:5: 00000004:00080000:2.0:1789518062.735675:0:9977:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789518062.735717:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1876445522609152:0@lo:900: 00000100:00100000:2.0:1789518062.735828:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518062.735903:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518062.736263:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609152 00000100:00100000:0.0:1789518062.736274:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609152 00000100:00100000:1.0:1789518062.736439:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518062.736450:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1876445522609152:12345-0@lo:900: 00000100:00100000:1.0:1789518062.736677:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9977:x1876445522609152:12345-0@lo:900: Request processed in 228us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518062.736685:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789518062.736884:0:9977:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f08380 x1876445522609152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789518078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518062.736896:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9977:1876445522609152:0@lo:900: 00000001:00080000:3.0:1789518063.111845:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1789518063.111867:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1789518063.607583:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522609280:0@lo:41: 00000100:00100000:3.0:1789518063.607691:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518063.607921:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609280 00000100:00100000:3.0:1789518063.607931:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609280 00000100:00100000:3.0:1789518063.608004:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789518063.608014:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522609280:12345-0@lo:41: 00000004:00000024:3.0:1789518063.608069:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518063.608154:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522609280:12345-0@lo:41: Request processed in 130us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518063.608167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789518063.608226:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522609280:0@lo:41: 00000100:00100000:3.0:1789518063.608629:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518063.608638:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522609408:0@lo:41: 00000100:00100000:3.0:1789518063.608671:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518063.609087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609408 00000100:00100000:2.0:1789518063.609093:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609408 00000100:00100000:2.0:1789518063.609140:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518063.609162:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522609408:12345-0@lo:41: 00000004:00000024:2.0:1789518063.609202:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789518063.609246:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522609408:12345-0@lo:41: Request processed in 90us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518063.609254:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518063.610903:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522609408:0@lo:41: 00000100:00100000:2.0:1789518063.612917:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518063.622973:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522609536:0@lo:13: 00000100:00100000:2.0:1789518063.623102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518063.623304:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609536 00000100:00100000:3.0:1789518063.623315:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609536 00000100:00100000:3.0:1789518063.623400:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518063.623412:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522609536:12345-0@lo:13: 00002000:00000024:3.0:1789518063.623455:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518063.623732:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522609536:12345-0@lo:13: Request processed in 321us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518063.623740:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789518063.624307:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302ab8380 x1876445522609536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518063.624333:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522609536:0@lo:13: 00010000:00010000:3.0:1789518063.670646:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789518064.514205:0:10032:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789518064.514713:0:10032:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518064.704725:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518065.717675:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789518065.843065:0:10081:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518065.843081:0:10081:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789518066.167935:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522609664:0@lo:13: 00000100:00100000:0.0:1789518066.168041:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518066.168301:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609664 00000100:00100000:0.0:1789518066.168309:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609664 00000100:00100000:0.0:1789518066.168376:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518066.168386:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522609664:12345-0@lo:13: 00002000:00000024:0.0:1789518066.168420:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518066.168494:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522609664:12345-0@lo:13: Request processed in 108us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518066.168502:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789518066.168533:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518066.168567:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e1f80 x1876445522609664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518066.168588:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522609664:0@lo:13: 00010000:00010000:3.0:1789518066.742029:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518067.348611:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518067.348728:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501587840 00000100:00100000:0.0:1789518067.348769:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501587840 00000100:00100000:0.0:1789518067.348831:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 180 00000100:00100000:0.0:1789518067.348841:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2386:x1876445501587840:12345-192.168.202.43@tcp:250: 00010000:00080000:0.0:1789518067.348878:0:6505:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 395607ea-c3c4-4708-8905-dac70dffbbe5@192.168.202.43@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1789518067.348917:0:6505:0:(genops.c:1384:class_connect()) connect: client 395607ea-c3c4-4708-8905-dac70dffbbe5, cookie 0x8d0fd679423141da 00000100:00080000:0.0:1789518067.349109:0:6505:0:(import.c:65:import_set_state_nolock()) ffff8e730292a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518067.349202:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+5:2386:x1876445501587840:12345-192.168.202.43@tcp:250: Request processed in 361us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518067.349211:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 180 00000100:00100000:1.0:1789518067.356041:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518067.356501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501587712 00000100:00100000:0.0:1789518067.356514:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501587712 00000100:00100000:0.0:1789518067.356588:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:0.0:1789518067.356600:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+5:6148:x1876445501587712:12345-192.168.202.43@tcp:101: 00010000:00010000:0.0:1789518067.356620:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518067.356644:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565f62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518067.356695:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518067.356708:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518067.356719:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9de00, rc 0) 00000100:00100000:0.0:1789518067.356813:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+6:6148:x1876445501587712:12345-192.168.202.43@tcp:101: Request processed in 214us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518067.356820:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:1.0:1789518067.369528:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518067.378803:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501587968 00000100:00100000:0.0:1789518067.378849:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501587968 00000100:00100000:0.0:1789518067.378939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00100000:0.0:1789518067.378951:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+6:6148:x1876445501587968:12345-192.168.202.43@tcp:501: 00000100:00100000:0.0:1789518067.379290:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+6:6148:x1876445501587968:12345-192.168.202.43@tcp:501: Request processed in 340us (9775us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518067.379299:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00100000:2.0:1789518067.386715:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.391552:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588096 00000100:00100000:3.0:1789518067.391576:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588096 00000100:00100000:3.0:1789518067.392139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 183 00000100:00100000:3.0:1789518067.392155:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+6:6148:x1876445501588096:12345-192.168.202.43@tcp:101: 00010000:00010000:3.0:1789518067.392265:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518067.392291:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565f69 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518067.392333:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518067.392346:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518067.392357:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166de00, rc 0) 00000100:00100000:3.0:1789518067.392447:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+7:6148:x1876445501588096:12345-192.168.202.43@tcp:101: Request processed in 296us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.392455:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 183 00000100:00100000:1.0:1789518067.398887:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518067.399005:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588224 00000100:00100000:0.0:1789518067.399028:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588224 00000100:00100000:0.0:1789518067.399100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 184 00000100:00100000:0.0:1789518067.399113:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+7:6148:x1876445501588224:12345-192.168.202.43@tcp:501: 00000100:00100000:0.0:1789518067.399345:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6148:x1876445501588224:12345-192.168.202.43@tcp:501: Request processed in 234us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518067.399354:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 184 00000100:00100000:1.0:1789518067.402070:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518067.402497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588352 00000100:00100000:2.0:1789518067.402510:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588352 00000100:00100000:2.0:1789518067.402588:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 185 00000100:00100000:2.0:1789518067.402599:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6148:x1876445501588352:12345-192.168.202.43@tcp:503: 00000100:00100000:2.0:1789518067.403083:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6148:x1876445501588352:12345-192.168.202.43@tcp:503: Request processed in 345us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.403096:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 185 00000100:00100000:2.0:1789518067.414198:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.414361:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588480 00000100:00100000:3.0:1789518067.414375:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588480 00000100:00100000:3.0:1789518067.414448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 186 00000100:00100000:3.0:1789518067.414524:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6167:x1876445501588480:12345-192.168.202.43@tcp:502: 00000100:00100000:3.0:1789518067.415022:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6167:x1876445501588480:12345-192.168.202.43@tcp:502: Request processed in 490us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.415031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 186 00000100:00100000:1.0:1789518067.482880:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.482992:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588608 00000100:00100000:3.0:1789518067.483007:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588608 00000100:00100000:3.0:1789518067.483091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:3.0:1789518067.483104:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6167:x1876445501588608:12345-192.168.202.43@tcp:502: 00000100:00100000:3.0:1789518067.483555:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6167:x1876445501588608:12345-192.168.202.43@tcp:502: Request processed in 451us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.483575:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:1.0:1789518067.502452:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.509862:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588736 00000100:00100000:3.0:1789518067.509885:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588736 00000100:00100000:3.0:1789518067.509990:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:3.0:1789518067.510003:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6148:x1876445501588736:12345-192.168.202.43@tcp:101: 00010000:00010000:3.0:1789518067.510053:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518067.510078:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e740166dc00/0x8d0fd679423141ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565f9a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518067.510118:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e740166dc00/0x8d0fd679423141ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f9a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518067.510130:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e740166dc00/0x8d0fd679423141ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f9a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518067.510141:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166dc00, rc 0) 00000100:00100000:3.0:1789518067.511154:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6148:x1876445501588736:12345-192.168.202.43@tcp:101: Request processed in 1144us (8706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.511167:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:2.0:1789518067.519208:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.519351:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588864 00000100:00100000:3.0:1789518067.519366:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588864 00000100:00100000:3.0:1789518067.519438:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:3.0:1789518067.519450:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6148:x1876445501588864:12345-192.168.202.43@tcp:256: 20000000:01000000:3.0:1789518067.519530:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789518067.519564:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789518067.519569:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789518067.519573:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789518067.519582:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789518067.519585:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789518067.523877:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6148:x1876445501588864:12345-192.168.202.43@tcp:256: Request processed in 4412us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.523897:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:1.0:1789518067.530884:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518067.532049:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501588992 00000100:00100000:2.0:1789518067.532068:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501588992 00000100:00100000:2.0:1789518067.532315:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:2.0:1789518067.532329:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6148:x1876445501588992:12345-192.168.202.43@tcp:101: 00010000:00010000:2.0:1789518067.532350:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518067.532373:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565fa1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518067.532434:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518067.532446:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518067.532457:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcfa00, rc 0) 00000100:00100000:2.0:1789518067.532562:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6148:x1876445501588992:12345-192.168.202.43@tcp:101: Request processed in 236us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.532569:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:0.0:1789518067.535890:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.535993:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501589120 00000100:00100000:3.0:1789518067.536005:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501589120 00000100:00100000:3.0:1789518067.536083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:3.0:1789518067.536095:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6148:x1876445501589120:12345-192.168.202.43@tcp:501: 00000100:00100000:3.0:1789518067.536318:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6148:x1876445501589120:12345-192.168.202.43@tcp:501: Request processed in 224us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.536326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:1.0:1789518067.539396:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.539510:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501589248 00000100:00100000:3.0:1789518067.539523:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501589248 00000100:00100000:3.0:1789518067.539593:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 192 00000100:00100000:3.0:1789518067.539604:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6148:x1876445501589248:12345-192.168.202.43@tcp:503: 00000100:00100000:3.0:1789518067.540291:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6148:x1876445501589248:12345-192.168.202.43@tcp:503: Request processed in 683us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.540301:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 192 00000100:00100000:0.0:1789518067.545692:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518067.545787:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501589376 00000100:00100000:2.0:1789518067.545799:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501589376 00000100:00100000:2.0:1789518067.545870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:2.0:1789518067.545882:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6172:x1876445501589376:12345-192.168.202.43@tcp:502: 00000100:00100000:2.0:1789518067.546103:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6172:x1876445501589376:12345-192.168.202.43@tcp:502: Request processed in 222us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.546113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:0.0:1789518067.549313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518067.549517:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501589504 00000100:00100000:3.0:1789518067.549531:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501589504 00000100:00100000:3.0:1789518067.549600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00100000:3.0:1789518067.549612:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6172:x1876445501589504:12345-192.168.202.43@tcp:502: 00000100:00100000:3.0:1789518067.549854:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6172:x1876445501589504:12345-192.168.202.43@tcp:502: Request processed in 243us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.549863:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00100000:0.0:1789518067.556666:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518067.556842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501589632 00000100:00100000:1.0:1789518067.556855:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501589632 00000100:00100000:1.0:1789518067.556915:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:1.0:1789518067.556926:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1876445501589632:12345-192.168.202.43@tcp:38: 00010000:00080000:1.0:1789518067.556975:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:1.0:1789518067.557050:0:6514:0:(genops.c:1384:class_connect()) connect: client 5499dd84-083f-4a57-a16b-aad857025063, cookie 0x8d0fd679423141fd 00000004:00100000:1.0:1789518067.557080:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789518067.557387:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8e7303535000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518067.557520:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2386:x1876445501589632:12345-192.168.202.43@tcp:38: Request processed in 592us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518067.557529:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:1.0:1789518067.566231:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518067.566458:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501589888 00000100:00100000:0.0:1789518067.566512:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501589888 00000100:00100000:0.0:1789518067.566578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789518067.566588:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1876445501589888:12345-192.168.202.43@tcp:38: 00010000:00080000:0.0:1789518067.566959:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1789518067.567041:0:6513:0:(genops.c:1384:class_connect()) connect: client 5499dd84-083f-4a57-a16b-aad857025063, cookie 0x8d0fd67942314204 00000004:00100000:0.0:1789518067.567075:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518067.567521:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8e743f88e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518067.567918:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2386:x1876445501589888:12345-192.168.202.43@tcp:38: Request processed in 1327us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518067.568006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:2.0:1789518067.702064:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522610048:0@lo:400: 00000100:00100000:2.0:1789518067.702161:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518067.702252:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522610560:0@lo:400: 00000100:00100000:2.0:1789518067.702281:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518067.702310:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522611072:0@lo:400: 00000100:00100000:2.0:1789518067.702338:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518067.702369:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789518067.702377:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522610176:0@lo:400: 00000100:00100000:2.0:1789518067.702413:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518067.702432:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522610688:0@lo:400: 00000100:00100000:2.0:1789518067.702452:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518067.702513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610048 00000100:00100000:2.0:1789518067.702523:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610048 00000100:00100000:2.0:1789518067.702585:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518067.702596:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522610048:12345-0@lo:400: 00000100:00100000:2.0:1789518067.702661:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522610048:12345-0@lo:400: Request processed in 66us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.702668:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518067.702695:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610560 00000100:00100000:2.0:1789518067.702699:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610560 00000100:00100000:2.0:1789518067.702732:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611072 00000100:00100000:2.0:1789518067.702735:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611072 00000100:00100000:2.0:1789518067.702748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610176 00000100:00100000:2.0:1789518067.702751:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610176 00000100:00100000:2.0:1789518067.702760:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610688 00000100:00100000:2.0:1789518067.702762:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610688 00000100:00100000:2.0:1789518067.702777:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518067.702783:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522610560:12345-0@lo:400: 00000100:00100000:2.0:1789518067.702814:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522610560:12345-0@lo:400: Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.702820:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518067.702831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518067.702837:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522611072:12345-0@lo:400: 00000100:00100000:2.0:1789518067.702865:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522611072:12345-0@lo:400: Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.702871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518067.702891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518067.702896:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522610176:12345-0@lo:400: 00000100:00100000:2.0:1789518067.702927:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522610176:12345-0@lo:400: Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.702932:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518067.703310:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518067.703320:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522610688:12345-0@lo:400: 00000100:00100000:2.0:1789518067.703353:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522610688:12345-0@lo:400: Request processed in 36us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518067.703359:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518067.703478:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522609792:0@lo:400: 00000100:00100000:3.0:1789518067.703522:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518067.703619:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522609920:0@lo:400: 00000100:00100000:0.0:1789518067.703653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518067.705900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609920 00000100:00100000:1.0:1789518067.705921:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609920 00000100:00080000:2.0:1789518067.706083:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518067.706092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789518067.706159:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301965880 x1876445522610176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518067.706241:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522610176:0@lo:400: 00010000:00080000:2.0:1789518067.706263:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f87a300 x1876445522610688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518067.706273:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522610688:0@lo:400: 00000100:00100000:2.0:1789518067.706289:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522610048:0@lo:400: 00010000:00080000:2.0:1789518067.706302:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f87b100 x1876445522610560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518067.706310:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522610560:0@lo:400: 00010000:00080000:2.0:1789518067.706323:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f879c00 x1876445522611072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518067.706361:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522611072:0@lo:400: 00000100:00100000:2.0:1789518067.706403:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518067.706416:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522611200:0@lo:400: 00000100:00100000:2.0:1789518067.706513:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518067.707102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518067.707115:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522609920:12345-0@lo:400: 00000100:00100000:0.0:1789518067.707367:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522609792 00000100:00100000:0.0:1789518067.707375:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522609792 00000100:00100000:0.0:1789518067.707414:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789518067.707423:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522609792:12345-0@lo:400: 00000100:00100000:3.0:1789518067.707546:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611200 00000100:00100000:3.0:1789518067.707552:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611200 00000100:00100000:3.0:1789518067.707595:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518067.707603:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522611200:12345-0@lo:400: 00000100:00080000:2.0:1789518067.707696:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518067.707746:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522610304:0@lo:400: 00000100:00100000:0.0:1789518067.710932:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522609792:12345-0@lo:400: Request processed in 3493us (7392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518067.710961:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789518067.711096:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522610432:0@lo:400: 00000100:00100000:0.0:1789518067.711148:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518067.712323:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522609920:12345-0@lo:400: Request processed in 5204us (8661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518067.712340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518067.712398:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610432 00000100:00100000:1.0:1789518067.712409:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610432 00000100:00100000:1.0:1789518067.712489:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518067.712499:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522610432:12345-0@lo:400: 00000100:00100000:1.0:1789518067.712569:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522610432:12345-0@lo:400: Request processed in 72us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518067.712576:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789518067.712596:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518067.713143:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f87b480 x1876445522610432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518067.713162:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522610432:0@lo:400: 00000100:00100000:0.0:1789518067.713184:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522610944:0@lo:400: 00000100:00100000:0.0:1789518067.713232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518067.713277:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522611456:0@lo:13: 00000100:00100000:0.0:1789518067.713306:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789518067.713337:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033d9500 x1876445522609920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518067.713347:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522609920:0@lo:400: 00000100:00100000:0.0:1789518067.713375:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611456 00000100:00100000:0.0:1789518067.713379:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611456 00000100:00100000:0.0:1789518067.713443:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518067.713450:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522611456:12345-0@lo:13: 00002000:00000024:0.0:1789518067.713494:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518067.713534:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522611456:12345-0@lo:13: Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518067.713541:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789518067.713563:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789518067.713582:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e3800 x1876445522611456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518067.713591:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789518067.713621:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522611456:0@lo:13: 00000100:00100000:3.0:1789518067.714036:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522611200:12345-0@lo:400: Request processed in 6430us (7519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.714046:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518067.714731:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610944 00000100:00100000:1.0:1789518067.714742:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610944 00000100:00100000:1.0:1789518067.714806:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518067.714816:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522610944:12345-0@lo:400: 00000100:00100000:1.0:1789518067.714881:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522610944:12345-0@lo:400: Request processed in 67us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518067.714887:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789518067.715068:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789518067.715857:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f878000 x1876445522610944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518067.715874:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522610944:0@lo:400: 00010000:00080000:0.0:1789518067.715920:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f87a680 x1876445522611200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518067.715930:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789518067.715954:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522611200:0@lo:400: 00000100:00100000:2.0:1789518067.717877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518067.718110:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610304 00000100:00100000:0.0:1789518067.718124:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610304 00000100:00100000:2.0:1789518067.718257:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522610816:0@lo:400: 00000100:00100000:2.0:1789518067.718314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518067.718424:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518067.718437:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522610304:12345-0@lo:400: 00000100:00100000:0.0:1789518067.718534:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522610304:12345-0@lo:400: Request processed in 99us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518067.718542:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518067.719781:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522611328:0@lo:400: 00000100:00100000:2.0:1789518067.719844:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518067.724902:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522609792:0@lo:400: 00000100:00100000:2.0:1789518067.724929:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522610304:0@lo:400: 00000100:00100000:3.0:1789518067.727075:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522610816 00000100:00100000:3.0:1789518067.727096:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522610816 00000100:00100000:3.0:1789518067.727342:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611328 00000100:00100000:3.0:1789518067.727348:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611328 00000100:00100000:1.0:1789518067.727435:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518067.727450:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522610816:12345-0@lo:400: 00000100:00100000:1.0:1789518067.727590:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522610816:12345-0@lo:400: Request processed in 144us (9274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518067.727598:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518067.727653:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518067.727660:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522611328:12345-0@lo:400: 00000100:00100000:1.0:1789518067.727706:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522611328:12345-0@lo:400: Request processed in 47us (7864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518067.727713:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789518067.727806:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f879880 x1876445522610816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518067.727825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522610816:0@lo:400: 00010000:00080000:2.0:1789518067.727840:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f87bb80 x1876445522611328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518067.727848:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522611328:0@lo:400: 00010000:00010000:3.0:1789518067.765664:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518068.214789:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518068.214828:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522611584:0@lo:13: 00000100:00100000:2.0:1789518068.214927:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518068.215819:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611584 00000100:00100000:0.0:1789518068.215832:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611584 00000100:00100000:0.0:1789518068.215999:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518068.216019:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522611584:12345-0@lo:13: 00002000:00000024:0.0:1789518068.216054:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518068.216141:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522611584:12345-0@lo:13: Request processed in 125us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518068.216149:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789518068.217673:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480ce00 x1876445522611584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518068.217728:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522611584:0@lo:13: 00000100:00100000:0.0:1789518068.570202:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518068.570276:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518068.570434:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501589760 00000100:00100000:2.0:1789518068.570444:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590016 00000100:00100000:1.0:1789518068.570448:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501589760 00000100:00100000:2.0:1789518068.570451:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590016 00000100:00100000:2.0:1789518068.570569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:2.0:1789518068.570582:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:0:x1876445501590016:12345-192.168.202.43@tcp:41: 00000004:00000024:2.0:1789518068.570642:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:3.0:1789518068.570719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518068.570725:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:0:x1876445501590016:12345-192.168.202.43@tcp:41: Request processed in 144us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.570734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00080000:3.0:1789518068.570866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518068.576831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789518068.576865:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:0:x1876445501589760:12345-192.168.202.43@tcp:41: 00000004:00000024:1.0:1789518068.576931:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789518068.577061:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:0:x1876445501589760:12345-192.168.202.43@tcp:41: Request processed in 208us (6867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518068.577070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:0.0:1789518068.591403:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518068.591712:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590144 00000100:00100000:2.0:1789518068.591734:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590144 00000100:00100000:2.0:1789518068.591814:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789518068.591826:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590144:12345-192.168.202.43@tcp:41: 00000004:00000024:2.0:1789518068.591869:0:8781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789518068.592190:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590144:12345-192.168.202.43@tcp:41: Request processed in 365us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.592199:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:3.0:1789518068.594223:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518068.596821:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590272 00000100:00100000:1.0:1789518068.596844:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590272 00000100:00100000:1.0:1789518068.597088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789518068.597101:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590272:12345-192.168.202.43@tcp:40: 00000100:00100000:1.0:1789518068.597277:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590272:12345-192.168.202.43@tcp:40: Request processed in 178us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518068.597287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:0.0:1789518068.603043:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518068.603176:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518068.603213:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518068.603244:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518068.603879:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590400 00000100:00100000:3.0:1789518068.603896:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590400 00000100:00100000:3.0:1789518068.603962:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590528 00000100:00100000:3.0:1789518068.603966:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590528 00000100:00100000:3.0:1789518068.603991:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:3.0:1789518068.604013:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1876445501590400:12345-192.168.202.43@tcp:8: 00010000:00080000:3.0:1789518068.604070:0:9982:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1789518068.604110:0:9982:0:(genops.c:1384:class_connect()) connect: client 5499dd84-083f-4a57-a16b-aad857025063, cookie 0x8d0fd6794231420b 00002000:00100000:3.0:1789518068.604125:0:9982:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5499dd84-083f-4a57-a16b-aad857025063/ffff8e73020d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518068.604147:0:9982:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789518068.604844:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590656 00000100:00100000:0.0:1789518068.604852:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590656 00000100:00100000:0.0:1789518068.606621:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:0.0:1789518068.606652:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590656:12345-192.168.202.43@tcp:900: 00000100:00100000:2.0:1789518068.607122:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590784 00000100:00100000:2.0:1789518068.607134:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590784 00000100:00100000:2.0:1789518068.607203:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 196 00000100:00100000:2.0:1789518068.607213:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501590784:12345-192.168.202.43@tcp:400: 00002000:00080000:3.0:1789518068.607871:0:9982:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789518068.608044:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590656:12345-192.168.202.43@tcp:900: Request processed in 1401us (4826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518068.608065:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:0.0:1789518068.608165:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789518068.608173:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1876445501590528:12345-192.168.202.43@tcp:8: 00010000:00080000:0.0:1789518068.608207:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:0.0:1789518068.608244:0:8427:0:(genops.c:1384:class_connect()) connect: client 5499dd84-083f-4a57-a16b-aad857025063, cookie 0x8d0fd67942314212 00002000:00100000:0.0:1789518068.608257:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5499dd84-083f-4a57-a16b-aad857025063/ffff8e743f88f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789518068.608914:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501590784:12345-192.168.202.43@tcp:400: Request processed in 1697us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.608986:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 196 00000100:00080000:3.0:1789518068.609185:0:9982:0:(import.c:65:import_set_state_nolock()) ffff8e73034e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518068.609245:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2386:x1876445501590400:12345-192.168.202.43@tcp:8: Request processed in 5244us (6219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518068.609253:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00002000:00100000:0.0:1789518068.610230:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789518068.613602:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789518068.613662:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8e743f889800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518068.613781:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2386:x1876445501590528:12345-192.168.202.43@tcp:8: Request processed in 5605us (10533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518068.613793:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:1.0:1789518068.617762:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518068.618883:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501590912 00000100:00100000:3.0:1789518068.618900:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501590912 00000100:00100000:3.0:1789518068.618981:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:3.0:1789518068.618994:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590912:12345-192.168.202.43@tcp:33: 00000004:00080000:2.0:1789518068.663038:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43887us 00000004:00200000:2.0:1789518068.701408:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789518068.701716:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+6:6148:x1876445501590912:12345-192.168.202.43@tcp:33: Request processed in 82717us (83960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.701748:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:3.0:1789518068.725825:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518068.725865:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522611712:0@lo:13: 00000100:00100000:3.0:1789518068.725962:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518068.726216:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518068.726228:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522611840:0@lo:41: 00000100:00100000:0.0:1789518068.726276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518068.726312:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611840 00000100:00100000:0.0:1789518068.726321:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611840 00000100:00100000:0.0:1789518068.726379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518068.726389:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522611840:12345-0@lo:41: 00000004:00000024:0.0:1789518068.726428:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789518068.726534:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522611840:12345-0@lo:41: Request processed in 146us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518068.726542:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789518068.726660:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518068.726672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522611968:0@lo:41: 00000100:00100000:2.0:1789518068.726704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518068.727300:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611968 00000100:00100000:1.0:1789518068.727309:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611968 00000100:00100000:1.0:1789518068.727343:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518068.727351:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522611968:12345-0@lo:41: 00000004:00000024:1.0:1789518068.727369:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789518068.727436:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522611968:12345-0@lo:41: Request processed in 86us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518068.727492:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789518068.731180:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522611840:0@lo:41: 00000100:00100000:2.0:1789518068.740855:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522611712 00000100:00100000:2.0:1789518068.740877:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522611712 00000100:00100000:2.0:1789518068.741100:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518068.741114:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522611712:12345-0@lo:13: 00002000:00000024:2.0:1789518068.741150:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518068.741720:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522611712:12345-0@lo:13: Request processed in 606us (15755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.741729:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789518068.741834:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302ab8e00 x1876445522611712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518068.741859:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522611712:0@lo:13: 00000100:00100000:1.0:1789518068.742012:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522611968:0@lo:41: 00010000:00010000:3.0:1789518068.789746:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518068.939358:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518068.939524:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591040 00000100:00100000:2.0:1789518068.939537:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591040 00000100:00100000:2.0:1789518068.939617:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789518068.939629:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:6190:x1876445501591040:12345-192.168.202.43@tcp:101: 00010000:00010000:2.0:1789518068.939656:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518068.939689:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dce600/0x8d0fd67942314219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565fd2 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518068.939780:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314220 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518068.940416:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518068.940513:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518068.940583:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518068.940587:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518068.940610:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518068.940652:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dce600/0x8d0fd67942314219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fd2 expref: 8 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518068.940678:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fd2 expref: 7 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518068.940689:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b7c00) 00010000:00010000:2.0:1789518068.940692:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518068.940698:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf600, rc 0) 00000100:00100000:2.0:1789518068.941770:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+7:6190:x1876445501591040:12345-192.168.202.43@tcp:101: Request processed in 2133us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.941784:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00010000:00010000:3.0:1789518069.813699:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518070.839443:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518071.285701:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518071.285738:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522612096:0@lo:13: 00000100:00100000:2.0:1789518071.285845:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518071.285882:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612096 00000100:00100000:1.0:1789518071.285893:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612096 00000100:00100000:1.0:1789518071.285985:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518071.285997:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522612096:12345-0@lo:13: 00002000:00000024:1.0:1789518071.286035:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518071.286097:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522612096:12345-0@lo:13: Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518071.286103:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789518071.286146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789518071.286771:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880380 x1876445522612096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518071.287166:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522612096:0@lo:13: 00000001:00100000:3.0:1789518071.292212:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000100:00100000:2.0:1789518071.307909:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518071.308075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591168 00000100:00100000:1.0:1789518071.308089:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591168 00000100:00080000:3.0:1789518071.308173:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518071.308195:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:1.0:1789518071.308210:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+7:6242:x1876445501591168:12345-192.168.202.43@tcp:41: 00000004:00000024:1.0:1789518071.308270:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789518071.308413:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+7:6242:x1876445501591168:12345-192.168.202.43@tcp:41: Request processed in 207us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518071.308422:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:0.0:1789518071.322125:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518071.322227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591296 00000100:00100000:3.0:1789518071.322242:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591296 00000100:00100000:3.0:1789518071.322334:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789518071.322344:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:6242:x1876445501591296:12345-192.168.202.43@tcp:41: 00000004:00000024:3.0:1789518071.322393:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:2.0:1789518071.322534:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518071.330172:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:6242:x1876445501591296:12345-192.168.202.43@tcp:41: Request processed in 7807us (8041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518071.330195:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:0.0:1789518071.339791:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518071.344186:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591424 00000100:00100000:1.0:1789518071.344208:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591424 00000100:00100000:1.0:1789518071.344383:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:1.0:1789518071.344395:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5499dd84-083f-4a57-a16b-aad857025063+6:6242:x1876445501591424:12345-192.168.202.43@tcp:13: 00002000:00000024:1.0:1789518071.344427:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518071.344562:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5499dd84-083f-4a57-a16b-aad857025063+6:6242:x1876445501591424:12345-192.168.202.43@tcp:13: Request processed in 167us (4783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518071.344744:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:1.0:1789518071.349426:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518071.349696:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591552 00000100:00100000:0.0:1789518071.349709:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591552 00000100:00080000:2.0:1789518071.350432:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518071.350440:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518071.350857:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:0.0:1789518071.350889:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5499dd84-083f-4a57-a16b-aad857025063+5:6242:x1876445501591552:12345-192.168.202.43@tcp:13: 00002000:00000024:0.0:1789518071.350937:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518071.351046:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5499dd84-083f-4a57-a16b-aad857025063+5:6242:x1876445501591552:12345-192.168.202.43@tcp:13: Request processed in 160us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518071.351054:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00010000:00010000:3.0:1789518071.861756:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518072.823001:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522612224:0@lo:13: 00000100:00100000:3.0:1789518072.823134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518072.823280:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612224 00000100:00100000:2.0:1789518072.823293:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612224 00000100:00100000:2.0:1789518072.823381:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518072.823393:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522612224:12345-0@lo:13: 00002000:00000024:2.0:1789518072.823420:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518072.823523:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522612224:12345-0@lo:13: Request processed in 133us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.823531:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789518072.823814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789518072.823856:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033d9500 x1876445522612224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518072.823880:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522612224:0@lo:13: 00000100:00100000:0.0:1789518072.824582:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522612480:0@lo:400: 00000100:00100000:0.0:1789518072.824661:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.824689:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522612992:0@lo:400: 00000100:00100000:0.0:1789518072.824715:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.824745:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522613504:0@lo:400: 00000100:00100000:0.0:1789518072.824766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.824790:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789518072.824796:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522612352:0@lo:400: 00000100:00100000:0.0:1789518072.824826:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.824854:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522612864:0@lo:400: 00000100:00100000:0.0:1789518072.824879:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.824898:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522613376:0@lo:400: 00000100:00100000:0.0:1789518072.824917:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.824950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612480 00000100:00100000:0.0:1789518072.824958:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612480 00000100:00100000:0.0:1789518072.825013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522613504 00000100:00100000:0.0:1789518072.825017:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522613504 00000100:00100000:0.0:1789518072.825049:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518072.825058:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522612480:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825111:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522612480:12345-0@lo:400: Request processed in 53us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825126:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518072.825146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789518072.825152:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522613504:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825181:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522613504:12345-0@lo:400: Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825187:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789518072.825206:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612992 00000100:00100000:0.0:1789518072.825210:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612992 00000100:00100000:0.0:1789518072.825239:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522613376 00000100:00100000:0.0:1789518072.825242:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522613376 00000100:00100000:0.0:1789518072.825258:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518072.825264:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522612992:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825294:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522612992:12345-0@lo:400: Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825300:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518072.825310:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518072.825315:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522613376:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825339:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522613376:12345-0@lo:400: Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825356:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518072.825380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612864 00000100:00100000:0.0:1789518072.825384:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612864 00000100:00100000:0.0:1789518072.825407:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518072.825413:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522612864:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825444:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522612864:12345-0@lo:400: Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825458:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518072.825523:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522612608:0@lo:400: 00000100:00100000:0.0:1789518072.825549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.825565:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522613120:0@lo:400: 00000100:00100000:0.0:1789518072.825582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.825594:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522613632:0@lo:400: 00000100:00100000:0.0:1789518072.825612:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.825627:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789518072.825632:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522612736:0@lo:400: 00000100:00100000:0.0:1789518072.825650:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.825662:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522613248:0@lo:400: 00000100:00100000:0.0:1789518072.825680:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.825693:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522613760:0@lo:400: 00000100:00100000:0.0:1789518072.825710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.825732:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522613120 00000100:00100000:0.0:1789518072.825736:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522613120 00000100:00100000:0.0:1789518072.825754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522613632 00000100:00100000:0.0:1789518072.825756:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522613632 00000100:00100000:0.0:1789518072.825767:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612736 00000100:00100000:0.0:1789518072.825769:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612736 00000100:00100000:0.0:1789518072.825780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522613248 00000100:00100000:0.0:1789518072.825782:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522613248 00000100:00100000:0.0:1789518072.825794:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518072.825800:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522613120:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825831:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522613120:12345-0@lo:400: Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825837:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518072.825856:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518072.825860:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522613632:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825885:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522613632:12345-0@lo:400: Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518072.825899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518072.825904:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522612736:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825923:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522612736:12345-0@lo:400: Request processed in 20us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825928:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518072.825936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789518072.825941:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522613248:12345-0@lo:400: 00000100:00100000:0.0:1789518072.825975:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522613248:12345-0@lo:400: Request processed in 21us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.825981:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789518072.825999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518072.826004:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518072.826006:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518072.826017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612608 00000100:00100000:0.0:1789518072.826020:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612608 00000100:00100000:0.0:1789518072.826037:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789518072.826041:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522612608:12345-0@lo:400: 00000100:00100000:0.0:1789518072.826067:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522612608:12345-0@lo:400: Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.826072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789518072.826088:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522613760 00000100:00100000:0.0:1789518072.826092:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522613760 00000100:00100000:0.0:1789518072.826124:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518072.826130:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522613760:12345-0@lo:400: 00000100:00100000:0.0:1789518072.826159:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522613760:12345-0@lo:400: Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.826165:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789518072.826180:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518072.826209:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522612736:0@lo:400: 00010000:00080000:0.0:1789518072.826222:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f883b80 x1876445522613248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518072.826232:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522613248:0@lo:400: 00010000:00080000:0.0:1789518072.826241:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880380 x1876445522613760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518072.826249:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522613760:0@lo:400: 00000100:00100000:0.0:1789518072.826258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522612608:0@lo:400: 00000100:00100000:0.0:1789518072.826267:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522613120:0@lo:400: 00010000:00080000:0.0:1789518072.826275:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881f80 x1876445522613632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518072.826282:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522613632:0@lo:400: 00000100:00100000:0.0:1789518072.826329:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522612864:0@lo:400: 00010000:00080000:0.0:1789518072.826343:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880a80 x1876445522613376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518072.826352:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522613376:0@lo:400: 00000100:00100000:0.0:1789518072.826364:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522612480:0@lo:400: 00010000:00080000:0.0:1789518072.826385:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881c00 x1876445522612992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518072.826393:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522612992:0@lo:400: 00000100:00100000:0.0:1789518072.826404:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522613504:0@lo:400: 00000100:00100000:1.0:1789518072.826832:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522612352 00000100:00100000:1.0:1789518072.826839:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522612352 00000100:00100000:1.0:1789518072.826882:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789518072.826890:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522612352:12345-0@lo:400: 00000100:00100000:1.0:1789518072.826951:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522612352:12345-0@lo:400: Request processed in 62us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518072.826957:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789518072.827458:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522612352:0@lo:400: 00010000:00010000:3.0:1789518072.891308:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518073.334447:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518073.334500:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522613888:0@lo:13: 00000100:00100000:2.0:1789518073.334601:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518073.336373:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522613888 00000100:00100000:0.0:1789518073.336393:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522613888 00000100:00100000:0.0:1789518073.336501:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518073.336515:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522613888:12345-0@lo:13: 00002000:00000024:0.0:1789518073.336555:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518073.336653:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522613888:12345-0@lo:13: Request processed in 142us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518073.336660:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789518073.336797:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6680 x1876445522613888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518073.336822:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522613888:0@lo:13: 00000001:00100000:2.0:1789518073.337003:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000001:00100000:0.0:1789518073.340087:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000100:00100000:2.0:1789518073.746924:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518073.746996:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518073.747047:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518073.747078:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592064 00000100:00100000:2.0:1789518073.747079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518073.747093:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592064 00000100:00100000:2.0:1789518073.747129:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518073.747160:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591680 00000100:00100000:2.0:1789518073.747165:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591680 00000100:00100000:1.0:1789518073.747184:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592192 00000100:00100000:1.0:1789518073.747189:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592192 00000100:00100000:2.0:1789518073.747213:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 198 00000100:00100000:1.0:1789518073.747221:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:2.0:1789518073.747228:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501591680:12345-192.168.202.43@tcp:400: 00000100:00100000:1.0:1789518073.747246:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501592064:12345-192.168.202.43@tcp:400: 00000100:00100000:3.0:1789518073.747366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591808 00000100:00100000:3.0:1789518073.747371:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591808 00000100:00100000:3.0:1789518073.747410:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501591936 00000100:00100000:3.0:1789518073.747413:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501591936 00000100:00100000:3.0:1789518073.747439:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:3.0:1789518073.747447:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501591808:12345-192.168.202.43@tcp:400: 00000100:00100000:2.0:1789518073.747572:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501591680:12345-192.168.202.43@tcp:400: Request processed in 347us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518073.747581:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 198 00000100:00100000:2.0:1789518073.747624:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:2.0:1789518073.747632:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501591936:12345-192.168.202.43@tcp:400: 00000100:00100000:0.0:1789518073.749406:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:0.0:1789518073.749431:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501592192:12345-192.168.202.43@tcp:400: 00000100:00100000:1.0:1789518073.751681:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501592064:12345-192.168.202.43@tcp:400: Request processed in 4434us (4667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518073.751699:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00080000:1.0:1789518073.753668:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518073.753679:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518073.753684:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518073.753687:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518073.754234:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501591808:12345-192.168.202.43@tcp:400: Request processed in 6773us (7316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518073.754251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:3.0:1789518073.755575:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501591936:12345-192.168.202.43@tcp:400: Request processed in 7919us (8472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518073.755591:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789518073.757431:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501592192:12345-192.168.202.43@tcp:400: Request processed in 7994us (10284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518073.757450:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:0.0:1789518073.845708:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518073.845744:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522614016:0@lo:13: 00000100:00100000:1.0:1789518073.845782:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522614144:0@lo:41: 00000100:00100000:0.0:1789518073.848115:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518073.848440:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522614272:0@lo:41: 00000100:00100000:0.0:1789518073.848523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518073.848572:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614016 00000100:00100000:2.0:1789518073.848583:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614016 00000100:00100000:2.0:1789518073.848651:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789518073.848662:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522614016:12345-0@lo:13: 00002000:00000024:2.0:1789518073.848702:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518073.848736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614272 00000100:00100000:0.0:1789518073.848757:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614272 00000100:00100000:2.0:1789518073.848765:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522614016:12345-0@lo:13: Request processed in 104us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518073.848775:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518073.849048:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518073.849056:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522614272:12345-0@lo:41: 00000004:00000024:0.0:1789518073.849083:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789518073.849125:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522614272:12345-0@lo:41: Request processed in 71us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518073.849132:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518073.849192:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522614272:0@lo:41: 00010000:00080000:0.0:1789518073.849237:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e7b80 x1876445522614016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518073.849254:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522614016:0@lo:13: 00000100:00100000:1.0:1789518073.851129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518073.851274:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614144 00000100:00100000:2.0:1789518073.851285:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614144 00000100:00100000:2.0:1789518073.851344:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518073.851356:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522614144:12345-0@lo:41: 00000004:00000024:2.0:1789518073.851399:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518073.851743:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522614144:12345-0@lo:41: Request processed in 388us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518073.851751:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518073.854643:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522614144:0@lo:41: 00010000:00010000:3.0:1789518073.909800:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789518074.360400:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000001:02000400:3.0:1789518074.692826:0:10179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789518074.933955:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518075.957844:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518076.406260:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522614400:0@lo:13: 00000100:00100000:2.0:1789518076.406342:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518076.406488:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614400 00000100:00100000:0.0:1789518076.406499:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614400 00000100:00100000:0.0:1789518076.406679:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518076.406690:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522614400:12345-0@lo:13: 00002000:00000024:0.0:1789518076.406721:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518076.406768:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522614400:12345-0@lo:13: Request processed in 80us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518076.406775:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789518076.406939:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e7b80 x1876445522614400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518076.406958:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522614400:0@lo:13: 00000100:00080000:1.0:1789518076.407103:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518076.984659:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518077.942587:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518077.942625:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522614528:0@lo:13: 00000100:00100000:3.0:1789518077.942719:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.942815:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614528 00000100:00100000:3.0:1789518077.942837:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614528 00000100:00100000:3.0:1789518077.942935:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518077.942950:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522614528:12345-0@lo:13: 00002000:00000024:3.0:1789518077.942987:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518077.943040:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522614528:12345-0@lo:13: Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.943048:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789518077.943073:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789518077.943113:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302ab8700 x1876445522614528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518077.943134:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522614528:0@lo:13: 00000100:00100000:3.0:1789518077.945433:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522614784:0@lo:400: 00000100:00100000:3.0:1789518077.945550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.945594:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522615296:0@lo:400: 00000100:00100000:3.0:1789518077.945653:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.945691:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522615808:0@lo:400: 00000100:00100000:3.0:1789518077.945720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.945746:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789518077.945752:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522614656:0@lo:400: 00000100:00100000:3.0:1789518077.945783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.945804:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522615168:0@lo:400: 00000100:00100000:3.0:1789518077.945828:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.945851:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522615680:0@lo:400: 00000100:00100000:3.0:1789518077.945874:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.945910:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614784 00000100:00100000:0.0:1789518077.946046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614656 00000100:00100000:0.0:1789518077.946055:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614656 00000100:00100000:0.0:1789518077.946125:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789518077.946135:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522614656:12345-0@lo:400: 00000100:00100000:0.0:1789518077.946214:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522614656:12345-0@lo:400: Request processed in 80us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518077.946223:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789518077.946359:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615296 00000100:00100000:1.0:1789518077.946365:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615296 00000100:00100000:1.0:1789518077.946428:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615680 00000100:00100000:1.0:1789518077.946432:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615680 00000100:00100000:1.0:1789518077.946452:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518077.946458:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522615296:12345-0@lo:400: 00000100:00100000:1.0:1789518077.946542:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522615296:12345-0@lo:400: Request processed in 84us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518077.946548:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518077.946560:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518077.946565:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522615680:12345-0@lo:400: 00000100:00100000:1.0:1789518077.946590:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522615680:12345-0@lo:400: Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518077.946596:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789518077.946730:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518077.947760:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614784 00000100:00100000:3.0:1789518077.947860:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615808 00000100:00100000:3.0:1789518077.947865:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615808 00000100:00100000:3.0:1789518077.947905:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789518077.947924:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522614784:12345-0@lo:400: 00000100:00100000:3.0:1789518077.948013:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522614784:12345-0@lo:400: Request processed in 100us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.948020:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789518077.948038:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789518077.948045:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522615808:12345-0@lo:400: 00000100:00100000:3.0:1789518077.948072:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522615808:12345-0@lo:400: Request processed in 28us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.948078:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789518077.948111:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615168 00000100:00100000:3.0:1789518077.948116:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615168 00000100:00100000:3.0:1789518077.948143:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789518077.948149:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522615168:12345-0@lo:400: 00000100:00100000:3.0:1789518077.948184:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522615168:12345-0@lo:400: Request processed in 35us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.948190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789518077.948246:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522615040:0@lo:400: 00000100:00100000:3.0:1789518077.948284:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.948314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522615552:0@lo:400: 00000100:00100000:3.0:1789518077.948335:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.948352:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522616064:0@lo:400: 00000100:00100000:3.0:1789518077.948373:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.948394:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789518077.948401:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522614912:0@lo:400: 00000100:00100000:3.0:1789518077.948436:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.948455:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522615424:0@lo:400: 00000100:00100000:3.0:1789518077.948508:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.948525:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522615936:0@lo:400: 00000100:00100000:3.0:1789518077.948553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.948576:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615040 00000100:00100000:3.0:1789518077.948580:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615040 00000100:00100000:3.0:1789518077.948598:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615552 00000100:00100000:3.0:1789518077.948600:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615552 00000100:00100000:3.0:1789518077.948614:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615424 00000100:00100000:3.0:1789518077.948616:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615424 00000100:00100000:3.0:1789518077.948629:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522615936 00000100:00100000:3.0:1789518077.948632:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522615936 00000100:00100000:3.0:1789518077.948645:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789518077.948651:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522615040:12345-0@lo:400: 00000100:00100000:3.0:1789518077.948687:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522615040:12345-0@lo:400: Request processed in 36us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.948693:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789518077.948706:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518077.948713:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522615552:12345-0@lo:400: 00000100:00100000:3.0:1789518077.948741:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522615552:12345-0@lo:400: Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.948746:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518077.948758:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518077.948764:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522615424:12345-0@lo:400: 00000100:00100000:3.0:1789518077.948789:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522615424:12345-0@lo:400: Request processed in 26us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.948805:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518077.948817:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518077.948822:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522615936:12345-0@lo:400: 00000100:00100000:3.0:1789518077.948851:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522615936:12345-0@lo:400: Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.948857:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518077.948875:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522614912 00000100:00100000:3.0:1789518077.948879:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522614912 00000100:00100000:3.0:1789518077.948899:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789518077.948906:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522614912:12345-0@lo:400: 00000100:00080000:1.0:1789518077.949014:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518077.949018:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518077.949030:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522616064 00000100:00100000:1.0:1789518077.949034:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522616064 00000100:00100000:1.0:1789518077.949075:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789518077.949081:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522616064:12345-0@lo:400: 00000100:00100000:1.0:1789518077.949116:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522616064:12345-0@lo:400: Request processed in 36us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518077.949122:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789518077.949141:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518077.952561:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522614912:12345-0@lo:400: Request processed in 3641us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.952580:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789518077.952689:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522614912:0@lo:400: 00000100:00100000:3.0:1789518077.952706:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522615424:0@lo:400: 00010000:00080000:3.0:1789518077.952723:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404813100 x1876445522615936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518077.952734:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522615936:0@lo:400: 00000100:00100000:3.0:1789518077.952748:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522615040:0@lo:400: 00010000:00080000:3.0:1789518077.952760:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404813480 x1876445522615552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518077.952769:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522615552:0@lo:400: 00010000:00080000:3.0:1789518077.952782:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811f80 x1876445522616064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518077.952810:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522616064:0@lo:400: 00000100:00100000:3.0:1789518077.952882:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522614656:0@lo:400: 00000100:00100000:3.0:1789518077.952896:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522615168:0@lo:400: 00010000:00080000:3.0:1789518077.952910:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404812680 x1876445522615680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518077.952930:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522615680:0@lo:400: 00000100:00100000:3.0:1789518077.953286:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522614784:0@lo:400: 00010000:00080000:3.0:1789518077.953307:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811880 x1876445522615296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518077.953315:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522615296:0@lo:400: 00000100:00100000:3.0:1789518077.953327:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522615808:0@lo:400: 00010000:00010000:0.0:1789518078.017937:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518078.371316:0:10326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc47682ab0 20000000:00000080:2.0:1789518078.371343:0:10326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e743f86f400 uarg=0000000000000000 20000000:01000000:2.0:1789518078.371415:0:10326:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789518078.371417:0:10326:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789518078.371421:0:10326:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789518078.371426:0:10326:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789518078.371432:0:10326:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789518078.372021:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789518078.372025:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789518078.373273:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1789518078.374366:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1789518078.374405:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1789518078.374421:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1789518078.374434:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789518078.374437:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789518078.375377:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1789518078.383553:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1789518078.383598:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1789518078.383613:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789518078.383626:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789518078.383629:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789518078.388386:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1789518078.388846:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1789518078.388890:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1789518078.388908:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1789518078.389099:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789518078.389102:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789518078.390372:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1789518078.390983:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1789518078.391014:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1789518078.391030:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1789518078.391042:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789518078.391045:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789518078.393545:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789518078.394206:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1789518078.394244:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1789518078.394258:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:2.0:1789518078.394275:0:10326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789518078.394304:0:10326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394344:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423140bb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394353:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394360:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314124 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394367:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314132 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394375:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314140 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394383:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231415c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394389:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314186 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394397:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394404:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423141cc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394415:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394434:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394444:0:10326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394532:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.394550:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 9 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.394568:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616192:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518078.398360:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.398387:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 9 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.398409:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616320:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518078.399488:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423141cc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.399507:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423141cc expref: 23 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.399520:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616448:0@lo:104: 00000100:00100000:2.0:1789518078.399579:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518078.399647:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.399657:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 23 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.399666:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616576:0@lo:104: 00000100:00100000:2.0:1789518078.399697:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518078.399718:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314186 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.399726:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314186 expref: 23 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.399733:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616704:0@lo:104: 00000100:00100000:1.0:1789518078.399942:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522616448 00000100:00100000:1.0:1789518078.399952:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522616448 00000100:00100000:1.0:1789518078.400007:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522616576 00000100:00100000:1.0:1789518078.400011:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522616576 00000100:00100000:1.0:1789518078.400027:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518078.400045:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:10326:x1876445522616448:12345-0@lo:104: 00010000:00010000:1.0:1789518078.400061:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400140:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518078.400147:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:10326:x1876445522616448:12345-0@lo:104: Request processed in 105us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.400170:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518078.400192:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518078.400198:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:10326:x1876445522616576:12345-0@lo:104: 00010000:00010000:1.0:1789518078.400206:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400241:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789518078.400246:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:10326:x1876445522616576:12345-0@lo:104: Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.400251:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789518078.400270:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518078.400277:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400284:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166d400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:1.0:1789518078.400289:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400297:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518078.400305:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518078.400317:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518078.400358:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400366:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518078.400389:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400396:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423141cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423141d3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400414:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518078.400416:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400422:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:1.0:1789518078.400424:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400431:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518078.400437:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518078.400442:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518078.400454:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400461:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518078.400494:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400500:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423141a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423141a9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.400511:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.400513:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.400515:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.400636:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518078.400653:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522616832:0@lo:103: 00000100:00100000:1.0:1789518078.400715:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518078.402970:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518078.402992:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522616960:0@lo:103: 00000100:00100000:1.0:1789518078.403075:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518078.403898:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518078.404010:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd6794231415c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.404030:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd6794231415c expref: 23 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.404045:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617088:0@lo:104: 00010000:00010000:2.0:1789518078.404075:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314140 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.404084:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314140 expref: 23 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.404093:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617216:0@lo:104: 00000100:00100000:0.0:1789518078.404268:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522616832 00000100:00100000:0.0:1789518078.404280:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522616832 00010000:00010000:0.0:1789518078.404324:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423141cc expref: 24 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.404356:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522616960 00000100:00100000:0.0:1789518078.404359:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522616960 00010000:00010000:0.0:1789518078.404373:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 25 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.404397:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518078.404408:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3639:x1876445522616832:12345-0@lo:103: 00010000:00010000:0.0:1789518078.404423:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518078.404428:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423141cc expref: 25 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.404441:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423141cc expref: 25 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.404481:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518078.404532:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3639:x1876445522616832:12345-0@lo:103: Request processed in 125us (3817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.404540:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518078.404594:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518078.404601:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522616960:12345-0@lo:103: 00010000:00010000:0.0:1789518078.404609:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518078.404614:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 24 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.404622:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 24 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.404632:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518078.404652:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522616960:12345-0@lo:103: Request processed in 51us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.404657:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518078.404870:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522616960:0@lo:103: 00000100:00100000:1.0:1789518078.404880:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522616832:0@lo:103: 00000100:00100000:1.0:1789518078.404948:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789518078.404966:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518078.404996:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518078.405005:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522616704 00000100:00100000:1.0:1789518078.405009:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522616704 00000100:00100000:1.0:1789518078.405032:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617088 00000100:00100000:1.0:1789518078.405035:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617088 00000100:00100000:1.0:1789518078.405045:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617216 00000100:00100000:1.0:1789518078.405047:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617216 00000100:00100000:1.0:1789518078.405058:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518078.405064:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:10326:x1876445522616704:12345-0@lo:104: 00010000:00010000:1.0:1789518078.405078:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.405316:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314132 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.405327:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314132 expref: 23 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.405337:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617344:0@lo:104: 00000100:00100000:2.0:1789518078.405361:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518078.405381:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314124 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.405389:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314124 expref: 23 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.405398:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617472:0@lo:104: 00000100:00100000:2.0:1789518078.405417:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518078.405432:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.405440:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 23 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.405448:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617600:0@lo:104: 00000100:00100000:2.0:1789518078.405484:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518078.405501:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423140bb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.405509:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423140bb expref: 23 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.405530:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617728:0@lo:104: 00000100:00100000:2.0:1789518078.405549:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518078.405560:0:10326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431759540 going to sleep for 11 seconds 00010000:00010000:2.0:1789518078.405575:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9ca00/0x8d0fd679423141d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423141cc expref: 23 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.405604:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616448:0@lo:104: 00010000:00010000:2.0:1789518078.405615:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcea00/0x8d0fd679423141a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423141a2 expref: 22 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.405624:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616576:0@lo:104: 00000100:00100000:2.0:1789518078.405632:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616704:0@lo:104: 00000100:00100000:0.0:1789518078.406240:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789518078.406251:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789518078.406528:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518078.406538:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:10326:x1876445522616704:12345-0@lo:104: Request processed in 1471us (2638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.406547:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518078.406600:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617344 00000100:00100000:1.0:1789518078.406606:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617344 00000100:00100000:1.0:1789518078.406626:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617472 00000100:00100000:1.0:1789518078.406629:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617472 00000100:00100000:1.0:1789518078.406637:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617600 00000100:00100000:1.0:1789518078.406640:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617600 00000100:00100000:1.0:1789518078.406650:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617728 00000100:00100000:1.0:1789518078.406653:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617728 00000100:00100000:1.0:1789518078.406665:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518078.406672:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+8:10326:x1876445522617088:12345-0@lo:104: 00010000:00010000:1.0:1789518078.406702:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.406810:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617088:0@lo:104: 00000100:00100000:2.0:1789518078.409873:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518078.409894:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616192:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518078.410233:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518078.410245:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.410258:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dce200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518078.410263:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.410276:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518078.410284:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518078.410305:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789518078.410330:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592320 00000100:00100000:0.0:1789518078.410339:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592320 00010000:00010000:0.0:1789518078.410385:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 10 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.410432:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789518078.410443:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501592320:12345-192.168.202.43@tcp:103: 00010000:00010000:0.0:1789518078.410482:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518078.410489:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 10 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.410503:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 10 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.410524:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740166de00/0x8d0fd679423141e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f69 expref: 10 pid: 6506 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.410545:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518078.410616:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+9:2387:x1876445501592320:12345-192.168.202.43@tcp:103: Request processed in 175us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.410624:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00010000:00010000:0.0:1789518078.413422:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.413442:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518078.413489:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.413521:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dce200/0x8d0fd67942314186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231418d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.413554:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522617856:0@lo:103: 00000100:00100000:0.0:1789518078.413622:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518078.413685:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522616320:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518078.413723:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617856 00000100:00100000:0.0:1789518078.413732:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617856 00010000:00010000:2.0:1789518078.414662:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518078.414673:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.414700:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166ca00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518078.414705:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.414716:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518078.414724:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518078.414971:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00010000:00010000:0.0:1789518078.415029:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314186 expref: 22 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518078.415074:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518078.415110:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.415118:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518078.415159:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.415167:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd6794231415c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314163 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.415236:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518078.415238:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518078.415241:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518078.415659:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592448 00000100:00100000:0.0:1789518078.415666:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592448 00010000:00010000:0.0:1789518078.415867:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 9 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.415897:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518078.415909:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3637:x1876445522617856:12345-0@lo:103: 00010000:00010000:0.0:1789518078.415936:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518078.415942:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314186 expref: 22 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.415953:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314186 expref: 22 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.415969:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcec00/0x8d0fd6794231418d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314186 expref: 22 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.415985:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518078.416055:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3637:x1876445522617856:12345-0@lo:103: Request processed in 148us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.416062:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518078.416082:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789518078.416089:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:395607ea-c3c4-4708-8905-dac70dffbbe5+9:2388:x1876445501592448:12345-192.168.202.43@tcp:103: 00010000:00010000:0.0:1789518078.416098:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518078.416103:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 9 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.416115:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 9 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.416950:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9de00/0x8d0fd679423141e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f62 expref: 9 pid: 6507 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.416986:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518078.417106:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:395607ea-c3c4-4708-8905-dac70dffbbe5+8:2388:x1876445501592448:12345-192.168.202.43@tcp:103: Request processed in 1014us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.417114:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789518078.417182:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522617984:0@lo:103: 00000100:00100000:0.0:1789518078.417239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518078.417322:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522617856:0@lo:103: 00000100:00100000:0.0:1789518078.417352:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522617984 00000100:00100000:0.0:1789518078.417357:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522617984 00010000:00010000:0.0:1789518078.417383:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231415c expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.417411:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518078.417433:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3638:x1876445522617984:12345-0@lo:103: 00010000:00010000:0.0:1789518078.417445:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518078.417452:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231415c expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.417483:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd6794231415c expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.417497:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9cc00/0x8d0fd67942314163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd6794231415c expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.417519:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518078.417549:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3638:x1876445522617984:12345-0@lo:103: Request processed in 118us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.417556:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518078.417585:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522617984:0@lo:103: 00010000:00010000:1.0:1789518078.418952:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789518078.418973:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+8:10326:x1876445522617088:12345-0@lo:104: Request processed in 12295us (13999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.418988:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518078.419051:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789518078.419068:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+7:10326:x1876445522617216:12345-0@lo:104: 00010000:00010000:1.0:1789518078.419087:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419190:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518078.419196:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+7:10326:x1876445522617216:12345-0@lo:104: Request processed in 137us (14199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.419218:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789518078.419234:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518078.419240:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419248:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:1.0:1789518078.419252:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419261:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518078.419268:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518078.419275:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518078.419318:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419324:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518078.419346:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419353:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd67942314140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314147 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419380:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.419382:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.419384:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518078.419392:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518078.419413:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522618112:0@lo:103: 00000100:00100000:1.0:1789518078.419452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518078.419521:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518078.419529:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:10326:x1876445522617344:12345-0@lo:104: 00010000:00010000:1.0:1789518078.419538:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419570:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518078.419575:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:10326:x1876445522617344:12345-0@lo:104: Request processed in 48us (14214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.419581:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518078.419593:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518078.419600:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:10326:x1876445522617472:12345-0@lo:104: 00010000:00010000:1.0:1789518078.419607:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419634:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789518078.419638:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:10326:x1876445522617472:12345-0@lo:104: Request processed in 40us (14222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.419644:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1789518078.419654:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518078.419657:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419664:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d800 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:1.0:1789518078.419667:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.419685:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518078.419705:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518078.419712:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518078.419728:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.420031:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522618112 00000100:00100000:0.0:1789518078.420040:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522618112 00010000:00010000:0.0:1789518078.420072:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314140 expref: 20 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518078.420099:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518078.420105:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3640:x1876445522618112:12345-0@lo:103: 00010000:00010000:0.0:1789518078.420118:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518078.420212:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518078.420219:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.420227:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d600 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518078.420230:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.420238:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518078.420244:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518078.420250:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518078.420278:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.420284:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518078.420303:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.420310:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd67942314124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231412b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.420333:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518078.420335:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518078.420337:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518078.420350:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522618368:0@lo:103: 00000100:00100000:2.0:1789518078.420394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518078.420425:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522618368 00000100:00100000:2.0:1789518078.420429:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522618368 00010000:00010000:2.0:1789518078.420446:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314124 expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.420482:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518078.420489:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3640:x1876445522618368:12345-0@lo:103: 00010000:00010000:2.0:1789518078.420497:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518078.420503:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314124 expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.420513:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314124 expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.420533:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518078.420570:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3640:x1876445522618368:12345-0@lo:103: Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.420577:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518078.420618:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522618368:0@lo:103: 00010000:00010000:2.0:1789518078.420641:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.420830:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789518078.421056:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522618240:0@lo:103: 00000100:00100000:2.0:1789518078.421091:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518078.421134:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522618240 00000100:00100000:2.0:1789518078.421138:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522618240 00010000:00010000:2.0:1789518078.421153:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314132 expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.421175:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518078.421182:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3637:x1876445522618240:12345-0@lo:103: 00010000:00010000:2.0:1789518078.421190:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518078.421194:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314132 expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.421203:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314132 expref: 21 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.421214:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518078.421239:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3637:x1876445522618240:12345-0@lo:103: Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.421246:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518078.421273:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522618240:0@lo:103: 00010000:00010000:0.0:1789518078.421381:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314140 expref: 20 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.421392:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314140 expref: 20 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518078.421416:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518078.421457:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3640:x1876445522618112:12345-0@lo:103: Request processed in 1352us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.421519:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522618112:0@lo:103: 00010000:00010000:1.0:1789518078.421588:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.421597:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314139 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.421622:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.421624:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.421626:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518078.421642:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518078.421652:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:10326:x1876445522617600:12345-0@lo:104: 00010000:00010000:1.0:1789518078.421662:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.421732:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518078.422228:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518078.422341:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:10326:x1876445522617600:12345-0@lo:104: Request processed in 691us (16855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.422348:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518078.422374:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789518078.422381:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:10326:x1876445522617728:12345-0@lo:104: 00010000:00010000:1.0:1789518078.422390:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.422436:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789518078.422442:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:10326:x1876445522617728:12345-0@lo:104: Request processed in 62us (16892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.422447:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1789518078.423602:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740166c400/0x8d0fd67942314147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314140 expref: 19 pid: 6505 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518078.423623:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617216:0@lo:104: 00010000:00010000:1.0:1789518078.423635:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcfe00/0x8d0fd67942314139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314132 expref: 18 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518078.423643:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617344:0@lo:104: 00010000:00010000:1.0:1789518078.423652:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dce400/0x8d0fd6794231412b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314124 expref: 17 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518078.423659:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617472:0@lo:104: 00000100:00100000:1.0:1789518078.423667:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617600:0@lo:104: 00010000:00010000:2.0:1789518078.423962:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518078.423988:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.423997:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d800 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518078.424002:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424013:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518078.424021:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518078.424028:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518078.424070:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424077:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518078.424100:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424108:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd679423140e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140ec expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424119:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518078.424132:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424139:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcee00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518078.424142:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424160:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518078.424167:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518078.424172:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518078.424186:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424192:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518078.424208:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424215:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcee00/0x8d0fd679423140bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140c2 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424230:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518078.424232:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518078.424233:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518078.424242:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518078.424258:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522618496:0@lo:103: 00000100:00100000:2.0:1789518078.424325:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518078.424361:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518078.424370:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522618624:0@lo:103: 00000100:00100000:2.0:1789518078.424426:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518078.424457:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522618496 00000100:00100000:2.0:1789518078.424488:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522618496 00010000:00010000:2.0:1789518078.424519:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 17 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.424554:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522618624 00000100:00100000:2.0:1789518078.424557:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522618624 00010000:00010000:2.0:1789518078.424568:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423140bb expref: 18 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518078.424583:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518078.424592:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:3637:x1876445522618496:12345-0@lo:103: 00010000:00010000:2.0:1789518078.424605:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518078.424610:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 18 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424621:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 18 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424635:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0c800/0x8d0fd679423140ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423140e5 expref: 18 pid: 6506 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.424648:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518078.424702:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:3637:x1876445522618496:12345-0@lo:103: Request processed in 110us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.424709:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518078.424727:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518078.424733:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:3640:x1876445522618624:12345-0@lo:103: 00000100:00100000:1.0:1789518078.425052:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1876445522617728:0@lo:104: 00010000:00010000:1.0:1789518078.425114:0:10326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426081:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518078.426089:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423140bb expref: 16 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426102:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423140bb expref: 16 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426201:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9c800/0x8d0fd679423140c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423140bb expref: 16 pid: 6507 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426228:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426237:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426258:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426266:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426273:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426279:0:9516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426285:0:9516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518078.426290:0:9516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426298:0:9516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426324:0:9516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518078.426348:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518078.426428:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:3640:x1876445522618624:12345-0@lo:103: Request processed in 1693us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.426436:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518078.426515:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522618496:0@lo:103: 00000100:00100000:2.0:1789518078.426551:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522618624:0@lo:103: 00010000:00010000:0.0:1789518078.426749:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518078.427542:0:10326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.427572:0:10326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518078.427579:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcf800/0x8d0fd67942314227 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518078.457295:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518078.472752:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522618752:0@lo:13: 00000100:00100000:3.0:1789518078.472853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518078.475633:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522618752 00000100:00100000:0.0:1789518078.475653:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522618752 00000100:00100000:0.0:1789518078.475881:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518078.475894:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522618752:12345-0@lo:13: 00002000:00000024:0.0:1789518078.475936:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518078.476054:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522618752:12345-0@lo:13: Request processed in 162us (3200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.476061:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789518078.476974:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e4e00 x1876445522618752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518078.477005:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522618752:0@lo:13: 00000100:00100000:0.0:1789518078.867088:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518078.867225:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518078.867270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518078.867311:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518078.867373:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592960 00000100:00100000:1.0:1789518078.867387:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592960 00000100:00100000:1.0:1789518078.867518:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:1.0:1789518078.867532:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501592960:12345-192.168.202.43@tcp:400: 00000100:00100000:1.0:1789518078.867627:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501592960:12345-192.168.202.43@tcp:400: Request processed in 98us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.867635:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00080000:1.0:1789518078.867661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518078.868105:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592576 00000100:00100000:2.0:1789518078.868112:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592576 00000100:00100000:2.0:1789518078.868159:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 200 00000100:00100000:2.0:1789518078.868168:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+8:2387:x1876445501592576:12345-192.168.202.43@tcp:400: 00000100:00100000:2.0:1789518078.868213:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+8:2387:x1876445501592576:12345-192.168.202.43@tcp:400: Request processed in 47us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.868220:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 200 00000100:00100000:3.0:1789518078.870327:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592704 00000100:00100000:3.0:1789518078.870350:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592704 00000100:00080000:0.0:1789518078.870719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518078.871084:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518078.871174:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593088 00000100:00100000:0.0:1789518078.871181:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593088 00000100:00100000:0.0:1789518078.871257:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789518078.871269:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501593088:12345-192.168.202.43@tcp:400: 00000100:00100000:0.0:1789518078.871368:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501593088:12345-192.168.202.43@tcp:400: Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518078.871377:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00080000:1.0:1789518078.871617:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518078.871841:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501592832 00000100:00100000:2.0:1789518078.871847:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501592832 00000100:00100000:2.0:1789518078.871969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:2.0:1789518078.871979:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501592704:12345-192.168.202.43@tcp:400: 00000100:00100000:2.0:1789518078.872028:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501592704:12345-192.168.202.43@tcp:400: Request processed in 52us (4960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.872034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:2.0:1789518078.872050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:2.0:1789518078.872056:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501592832:12345-192.168.202.43@tcp:400: 00000100:00100000:2.0:1789518078.872087:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501592832:12345-192.168.202.43@tcp:400: Request processed in 31us (4776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518078.872112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00080000:1.0:1789518078.875988:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518078.965815:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522618880:0@lo:13: 00000100:00100000:0.0:1789518078.965815:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522619008:0@lo:41: 00000100:00100000:1.0:1789518078.966032:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518078.966049:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522619136:0@lo:41: 00000100:00100000:3.0:1789518078.969985:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518078.972351:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522618880 00000100:00100000:3.0:1789518078.972371:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522618880 00000100:00100000:3.0:1789518078.972447:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518078.972489:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522618880:12345-0@lo:13: 00002000:00000024:3.0:1789518078.972530:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518078.972775:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522618880:12345-0@lo:13: Request processed in 314us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518078.972783:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789518078.972841:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303559500 x1876445522618880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518078.972877:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522618880:0@lo:13: 00000100:00100000:0.0:1789518078.974591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518078.975708:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619008 00000100:00100000:3.0:1789518078.975724:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619008 00000100:00100000:3.0:1789518078.975797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789518078.975807:0:6518:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789518078.975810:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522619008:12345-0@lo:41: 00000100:00100000:0.0:1789518078.975817:0:6518:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:3.0:1789518078.979050:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518078.979807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518078.979849:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619136 00000100:00100000:1.0:1789518078.979860:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619136 00000100:00100000:1.0:1789518078.979902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518078.979925:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522619136:12345-0@lo:41: 00000004:00000024:1.0:1789518078.979966:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518078.980001:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522619136:12345-0@lo:41: Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518078.980018:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518078.980088:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522619136:0@lo:41: 00000100:00100000:3.0:1789518078.983824:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522619008:12345-0@lo:41: Request processed in 8000us (9224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518078.983844:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789518078.984019:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522619008:0@lo:41: 00010000:00010000:1.0:1789518079.030219:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518079.447229:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518079.447663:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593216 00000100:00100000:2.0:1789518079.447687:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593216 00000100:00100000:2.0:1789518079.447800:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:2.0:1789518079.447813:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+8:6162:x1876445501593216:12345-192.168.202.43@tcp:101: 00010000:00010000:2.0:1789518079.447833:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518079.447859:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcea00/0x8d0fd6794231422e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565fd9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.447896:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcea00/0x8d0fd6794231422e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fd9 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.447919:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcea00/0x8d0fd6794231422e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fd9 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.447931:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcea00, rc 0) 00000100:00100000:2.0:1789518079.448020:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6162:x1876445501593216:12345-192.168.202.43@tcp:101: Request processed in 209us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.448027:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:2.0:1789518079.451911:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518079.454078:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593344 00000100:00100000:1.0:1789518079.454255:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593344 00000100:00100000:1.0:1789518079.454419:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:1.0:1789518079.454432:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6162:x1876445501593344:12345-192.168.202.43@tcp:501: 00000100:00100000:1.0:1789518079.454708:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6162:x1876445501593344:12345-192.168.202.43@tcp:501: Request processed in 279us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.454717:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:1.0:1789518079.458795:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518079.458914:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593472 00000100:00100000:2.0:1789518079.458929:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593472 00000100:00100000:2.0:1789518079.459004:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:2.0:1789518079.459025:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6162:x1876445501593472:12345-192.168.202.43@tcp:503: 00000100:00100000:2.0:1789518079.459231:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6162:x1876445501593472:12345-192.168.202.43@tcp:503: Request processed in 208us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.459240:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:2.0:1789518079.470649:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518079.471304:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593600 00000100:00100000:1.0:1789518079.471319:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593600 00000100:00100000:1.0:1789518079.471426:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 204 00000100:00100000:1.0:1789518079.471436:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6637:x1876445501593600:12345-192.168.202.43@tcp:502: 00000100:00100000:1.0:1789518079.471661:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6637:x1876445501593600:12345-192.168.202.43@tcp:502: Request processed in 226us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.471668:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 204 10000000:01000000:0.0:1789518079.477867:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789518079.477875:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e730205a000 from 48 10000000:01000000:0.0:1789518079.477880:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518079.477949:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.477959:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.477970:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.477994:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619264:0@lo:101: 00000100:00100000:0.0:1789518079.478084:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.478141:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405736000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.478181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619264 00000100:00100000:3.0:1789518079.478191:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619264 00000100:00100000:3.0:1789518079.478252:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789518079.478264:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+15:6509:x1876445522619264:12345-0@lo:101: 00010000:00010000:3.0:1789518079.478296:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518079.478313:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030000/0x8d0fd6794231423c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314235 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.478344:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030000/0x8d0fd6794231423c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314235 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.478357:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030000/0x8d0fd6794231423c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314235 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.478368:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030000, rc 0) 00000100:00100000:3.0:1789518079.478699:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522619264:12345-0@lo:101: Request processed in 436us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518079.478707:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789518079.478939:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619264:0@lo:101: 00010000:00010000:0.0:1789518079.478957:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.478968:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.481218:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619392:0@lo:501: 00000100:00100000:0.0:1789518079.481311:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.481461:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405736000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518079.481984:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619392 00000100:00100000:1.0:1789518079.481995:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619392 00000100:00100000:1.0:1789518079.482225:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789518079.482237:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522619392:12345-0@lo:501: 00000100:00100000:1.0:1789518079.482440:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522619392:12345-0@lo:501: Request processed in 206us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.482457:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789518079.482561:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619392:0@lo:501: 00000100:00100000:0.0:1789518079.482609:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619520:0@lo:503: 00000100:00100000:0.0:1789518079.482659:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.483185:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619520 00000100:00100000:2.0:1789518079.483192:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619520 00000100:00100000:0.0:1789518079.483209:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405736000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.483219:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789518079.483227:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522619520:12345-0@lo:503: 00000100:00100000:2.0:1789518079.483444:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522619520:12345-0@lo:503: Request processed in 216us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.483451:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789518079.483624:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619520:0@lo:503: 00000100:00100000:1.0:1789518079.484412:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10346:1876445522619648:0@lo:502: 00000100:00100000:1.0:1789518079.484576:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518079.484619:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fda900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.484768:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619648 00000100:00100000:2.0:1789518079.484835:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619648 00000100:00100000:2.0:1789518079.484925:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789518079.484935:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:10346:x1876445522619648:12345-0@lo:502: 00000100:00100000:2.0:1789518079.485232:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:10346:x1876445522619648:12345-0@lo:502: Request processed in 298us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.485240:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789518079.485414:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10346:1876445522619648:0@lo:502: 00000100:00100000:1.0:1789518079.485600:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10346:1876445522619776:0@lo:502: 00000100:00100000:1.0:1789518079.485639:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518079.485803:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74053ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.488078:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619776 00000100:00100000:3.0:1789518079.488099:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619776 00000100:00100000:0.0:1789518079.488230:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789518079.488246:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:10346:x1876445522619776:12345-0@lo:502: 00000100:00100000:0.0:1789518079.488997:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:10346:x1876445522619776:12345-0@lo:502: Request processed in 750us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.489091:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10346:1876445522619776:0@lo:502: 00000040:00080000:1.0:1789518079.489141:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789518079.489298:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789518079.489396:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518079.489410:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.489423:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518079.489435:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789518079.489438:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789518079.489442:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00000100:00100000:0.0:1789518079.489591:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00010000:2.0:1789518079.489744:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.489770:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.489846:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518079.489870:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619904:0@lo:101: 00000100:00100000:2.0:1789518079.489932:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.490026:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.490225:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518079.493422:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522619904 00000100:00100000:1.0:1789518079.493441:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522619904 00000100:00100000:1.0:1789518079.493533:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593728 00000100:00100000:1.0:1789518079.493546:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593728 00000100:00100000:3.0:1789518079.493943:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789518079.493957:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+16:6509:x1876445522619904:12345-0@lo:101: 00010000:00010000:3.0:1789518079.493984:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518079.494079:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231424a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314243 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.494179:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231424a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314243 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.494194:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231424a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314243 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.494205:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030c00, rc 0) 00000100:00100000:3.0:1789518079.494444:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522619904:12345-0@lo:101: Request processed in 491us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518079.494452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789518079.494542:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:0.0:1789518079.494554:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6637:x1876445501593728:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518079.494710:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6637:x1876445501593728:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 159us (4486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.494718:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:2.0:1789518079.495066:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522619904:0@lo:101: 00010000:00010000:2.0:1789518079.495085:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.495094:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518079.495373:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620032:0@lo:501: 00000100:00100000:2.0:1789518079.495412:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.495449:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518079.495451:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620032 00000100:00100000:1.0:1789518079.495458:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620032 00000100:00100000:1.0:1789518079.495510:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789518079.495518:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522620032:12345-0@lo:501: 00000100:00100000:1.0:1789518079.495798:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522620032:12345-0@lo:501: Request processed in 280us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.495806:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789518079.495824:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620032:0@lo:501: 00000100:00100000:2.0:1789518079.495850:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620160:0@lo:503: 00000100:00100000:2.0:1789518079.495884:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.495965:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.495996:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620160 00000100:00100000:3.0:1789518079.496220:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620160 00000100:00100000:3.0:1789518079.496255:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789518079.496263:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522620160:12345-0@lo:503: 00000100:00100000:3.0:1789518079.496617:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522620160:12345-0@lo:503: Request processed in 354us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518079.496624:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789518079.496753:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620160:0@lo:503: 00000100:00100000:0.0:1789518079.497225:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10347:1876445522620288:0@lo:502: 00000100:00100000:0.0:1789518079.497289:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518079.497585:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518079.497710:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620288 00000100:00100000:2.0:1789518079.497724:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620288 00000100:00100000:2.0:1789518079.497769:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593856 00000100:00100000:2.0:1789518079.497772:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593856 00000100:00100000:2.0:1789518079.497788:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789518079.497795:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:10347:x1876445522620288:12345-0@lo:502: 00000100:00100000:2.0:1789518079.497898:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:10347:x1876445522620288:12345-0@lo:502: Request processed in 104us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.497916:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789518079.497951:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00100000:2.0:1789518079.497957:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6162:x1876445501593856:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518079.497967:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518079.497992:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcee00/0x8d0fd67942314251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565fe0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.498079:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7407d0b600 going to sleep for 11 seconds 00010000:00010000:2.0:1789518079.498096:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcee00/0x8d0fd67942314251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe0 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.498109:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcee00/0x8d0fd67942314251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe0 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.498113:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10347:1876445522620288:0@lo:502: 00010000:00010000:2.0:1789518079.498127:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcee00, rc 0) 00000020:01000000:0.0:1789518079.498144:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518079.498155:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518079.498158:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518079.498163:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789518079.498170:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501593856:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 214us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.498176:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00100000:0.0:1789518079.498191:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10347:1876445522620416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.498229:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.498253:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.498804:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620416 00000100:00100000:0.0:1789518079.498812:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620416 00000100:00100000:0.0:1789518079.498852:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789518079.498859:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:10347:x1876445522620416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518079.498989:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10347:1876445522620416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518079.499083:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518079.499090:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518079.499091:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518079.499096:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000100:00100000:0.0:1789518079.499229:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:10347:x1876445522620416:12345-0@lo:502:llog_process_th.0 Request processed in 114us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.499240:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000020:01000000:2.0:1789518079.499440:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 00000100:00100000:3.0:1789518079.500330:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518079.500499:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501593984 00000100:00100000:0.0:1789518079.500508:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501593984 00000100:00100000:0.0:1789518079.500611:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 217 00000100:00100000:0.0:1789518079.500622:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501593984:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.500868:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501593984:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 248us (547us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518079.500876:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 217 10000000:01000000:2.0:1789518079.501665:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789518079.501740:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.501779:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518079.501791:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789518079.501795:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7435dc1800 from 48 10000000:01000000:2.0:1789518079.501798:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518079.501838:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.501847:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.501857:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518079.501882:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.501946:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.502093:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b4309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.502181:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620544 00000100:00100000:0.0:1789518079.502188:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620544 00000100:00100000:0.0:1789518079.502232:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789518079.502240:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+17:6509:x1876445522620544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518079.502251:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518079.502266:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9de00/0x8d0fd6794231425f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314258 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.502292:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9de00/0x8d0fd6794231425f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314258 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.502393:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9de00/0x8d0fd6794231425f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314258 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.502402:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9de00, rc 0) 00000100:00100000:0.0:1789518079.502506:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522620544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.502513:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789518079.502837:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518079.502855:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.502866:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518079.502948:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.502980:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.503128:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b4309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.503225:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620672 00000100:00100000:0.0:1789518079.503230:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620672 00000100:00100000:0.0:1789518079.503270:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789518079.503278:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522620672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.504181:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522620672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 900us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.504190:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789518079.504434:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.504517:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.504582:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.504615:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b4309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.504733:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620800 00000100:00100000:0.0:1789518079.504739:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620800 00000100:00100000:0.0:1789518079.504776:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789518079.504784:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522620800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.504884:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522620800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.504890:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789518079.505136:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522620800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.506129:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10348:1876445522620928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.506196:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.506237:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.506410:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522620928 00000100:00100000:0.0:1789518079.506417:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522620928 00000100:00100000:0.0:1789518079.506481:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789518079.506491:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:10348:x1876445522620928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.506761:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:10348:x1876445522620928:12345-0@lo:502:llog_process_th.0 Request processed in 273us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.506768:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789518079.507136:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10348:1876445522620928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.507199:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10348:1876445522621056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.507240:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.507261:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.507431:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621056 00000100:00100000:0.0:1789518079.507435:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621056 00000100:00100000:0.0:1789518079.507783:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789518079.507795:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:10348:x1876445522621056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.507892:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:10348:x1876445522621056:12345-0@lo:502:llog_process_th.0 Request processed in 100us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.507951:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10348:1876445522621056:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789518079.507974:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:0.0:1789518079.509103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000020:01000000:0.0:1789518079.509216:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789518079.509243:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518079.509255:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.509268:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518079.509279:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789518079.509282:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789518079.509286:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789518079.509985:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.510054:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.510069:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.510110:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.510192:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.510236:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.512241:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621184 00000100:00100000:2.0:1789518079.512259:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621184 00000100:00100000:2.0:1789518079.512347:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789518079.512359:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+18:6509:x1876445522621184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518079.512379:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518079.512401:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcfe00/0x8d0fd6794231426d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314266 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.512433:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcfe00/0x8d0fd6794231426d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314266 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.512490:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcfe00/0x8d0fd6794231426d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314266 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.512927:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcfe00, rc 0) 00000100:00100000:2.0:1789518079.513085:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522621184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 728us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.513093:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789518079.516424:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518079.516782:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.516800:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.516956:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.517149:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.517213:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518079.517370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621312 00000100:00100000:1.0:1789518079.517390:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621312 00000100:00100000:1.0:1789518079.517448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789518079.517459:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522621312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518079.518307:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522621312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 849us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.518330:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789518079.519296:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.519439:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.519953:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.520128:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.520453:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621440 00000100:00100000:0.0:1789518079.520762:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621440 00000100:00100000:0.0:1789518079.520941:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789518079.520953:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522621440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.521153:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522621440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.521162:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789518079.521251:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.522416:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10349:1876445522621568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.522526:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.523811:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518079.524343:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621568 00000100:00100000:1.0:1789518079.524354:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621568 00000100:00100000:1.0:1789518079.524417:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789518079.524427:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:10349:x1876445522621568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518079.525027:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:10349:x1876445522621568:12345-0@lo:502:llog_process_th.0 Request processed in 599us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.525036:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789518079.525452:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10349:1876445522621568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518079.525731:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518079.525743:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518079.525746:0:10349:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789518079.525753:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789518079.525856:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10349:1876445522621696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.525919:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.525984:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518079.526068:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621696 00000100:00100000:1.0:1789518079.526075:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621696 00000100:00100000:1.0:1789518079.526211:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789518079.526219:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:10349:x1876445522621696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518079.526311:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:10349:x1876445522621696:12345-0@lo:502:llog_process_th.0 Request processed in 93us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.526403:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10349:1876445522621696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518079.526425:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518079.526428:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518079.526431:0:10349:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789518079.526435:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000100:00100000:1.0:1789518079.527068:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000020:01000000:3.0:1789518079.527182:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789518079.527212:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789518079.527224:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.527239:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518079.527250:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789518079.527253:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e74044cd800 from 48 10000000:01000000:3.0:1789518079.527257:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518079.527289:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.527307:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.527327:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518079.527347:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518079.527391:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.528200:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621824 00000100:00100000:0.0:1789518079.528211:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621824 00000100:00100000:0.0:1789518079.528254:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789518079.528264:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:6509:x1876445522621824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518079.528278:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518079.528303:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9c800/0x8d0fd6794231427b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314274 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.528341:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9c800/0x8d0fd6794231427b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314274 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.528353:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9c800/0x8d0fd6794231427b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314274 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.528362:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c800, rc 0) 00000100:00100000:0.0:1789518079.528411:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522621824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.528417:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789518079.528762:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.528796:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518079.528814:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.528824:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518079.528917:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518079.528954:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518079.528982:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.529221:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522621952 00000100:00100000:0.0:1789518079.529226:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522621952 00000100:00100000:0.0:1789518079.529251:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789518079.529257:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522621952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.529409:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522621952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.529416:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789518079.530089:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522621952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518079.530258:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518079.530344:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518079.530364:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.530508:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622080 00000100:00100000:0.0:1789518079.530514:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622080 00000100:00100000:0.0:1789518079.530548:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789518079.530555:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522622080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.531025:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522622080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 469us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.531034:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789518079.531272:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518079.532726:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10350:1876445522622208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518079.533261:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518079.533307:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fdab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.533872:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622208 00000100:00100000:0.0:1789518079.533894:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622208 00000100:00100000:0.0:1789518079.533970:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789518079.533981:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:10350:x1876445522622208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.534444:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:10350:x1876445522622208:12345-0@lo:502:llog_process_th.0 Request processed in 464us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.534453:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789518079.534706:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10350:1876445522622208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518079.535070:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10350:1876445522622336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518079.535188:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518079.535259:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fdab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.535299:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622336 00000100:00100000:2.0:1789518079.535305:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622336 00000100:00100000:2.0:1789518079.535453:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789518079.535880:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:10350:x1876445522622336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.536096:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:10350:x1876445522622336:12345-0@lo:502:llog_process_th.0 Request processed in 634us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.536104:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789518079.536219:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10350:1876445522622336:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789518079.536249:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789518079.537196:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789518079.537229:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518079.537243:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.537257:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518079.537269:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789518079.537272:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789518079.537276:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789518079.537313:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.537416:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.537427:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.537451:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.537740:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518079.537921:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622464 00000100:00100000:1.0:1789518079.537930:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622464 00000100:00100000:1.0:1789518079.537989:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789518079.538108:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518079.538179:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522622464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518079.538193:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518079.538210:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942314289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314282 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518079.538237:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942314289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314282 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518079.538249:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942314289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314282 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518079.538258:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0de00, rc 0) 00000100:00100000:1.0:1789518079.538296:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522622464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.538303:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789518079.538426:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518079.538441:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.538452:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.538759:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.539192:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.549373:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622592 00000100:00100000:2.0:1789518079.549394:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622592 00000100:00100000:2.0:1789518079.549491:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789518079.549817:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.549942:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522622592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.550203:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522622592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (11010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.550282:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.550351:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.550417:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.550456:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518079.552882:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622720 00000100:00100000:1.0:1789518079.552911:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622720 00000100:00100000:2.0:1789518079.553376:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789518079.553962:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789518079.553981:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522622720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518079.554337:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522622720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 361us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518079.554345:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789518079.554452:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522622720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.555433:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10351:1876445522622848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.555549:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.556091:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.556277:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622848 00000100:00100000:3.0:1789518079.556298:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622848 00000100:00100000:3.0:1789518079.556417:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789518079.556428:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10351:x1876445522622848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518079.556952:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10351:x1876445522622848:12345-0@lo:502:llog_process_th.0 Request processed in 524us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518079.556961:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789518079.557306:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10351:1876445522622848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518079.557412:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518079.557424:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518079.557426:0:10351:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518079.557433:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789518079.557843:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10351:1876445522622976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.557918:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.558074:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.558243:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522622976 00000100:00100000:2.0:1789518079.558251:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522622976 00000100:00100000:2.0:1789518079.558291:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789518079.558300:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10351:x1876445522622976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.558437:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10351:x1876445522622976:12345-0@lo:502:llog_process_th.0 Request processed in 139us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.558445:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789518079.558595:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10351:1876445522622976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518079.558621:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518079.558627:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518079.558629:0:10351:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518079.558634:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789518079.559013:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789518079.559036:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789518079.559054:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.559066:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518079.559078:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789518079.559081:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7439644800 from 48 10000000:01000000:2.0:1789518079.559084:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518079.559124:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.559133:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.559143:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518079.559161:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.559198:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.559236:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.559816:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522623104 00000100:00100000:0.0:1789518079.559824:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522623104 00000100:00100000:0.0:1789518079.559861:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789518079.559870:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522623104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518079.559881:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518079.559896:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9d600/0x8d0fd67942314297 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314290 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.559935:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9d600/0x8d0fd67942314297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314290 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.559944:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9d600/0x8d0fd67942314297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314290 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.559953:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d600, rc 0) 00000100:00100000:0.0:1789518079.560006:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522623104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.560013:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789518079.560341:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518079.560357:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.560367:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518079.560437:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.560509:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.560536:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.560913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522623232 00000100:00100000:0.0:1789518079.560919:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522623232 00000100:00100000:0.0:1789518079.560943:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789518079.560949:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522623232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.561084:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522623232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.561098:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789518079.561277:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.561308:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.561356:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.561381:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.561422:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522623360 00000100:00100000:0.0:1789518079.561426:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522623360 00000100:00100000:0.0:1789518079.561441:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789518079.561446:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522623360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.561547:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522623360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.561554:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789518079.561941:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.562394:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10352:1876445522623488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.562441:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.562756:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522623488 00000100:00100000:0.0:1789518079.562763:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522623488 00000100:00100000:0.0:1789518079.562850:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789518079.562857:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10352:x1876445522623488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.562970:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10352:x1876445522623488:12345-0@lo:502:llog_process_th.0 Request processed in 113us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.562977:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789518079.563087:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.563104:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10352:1876445522623488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.563202:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10352:1876445522623616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.563232:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.563253:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.563299:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522623616 00000100:00100000:0.0:1789518079.563303:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522623616 00000100:00100000:0.0:1789518079.563327:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789518079.563332:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10352:x1876445522623616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.563393:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10352:x1876445522623616:12345-0@lo:502:llog_process_th.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.563400:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789518079.563525:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10352:1876445522623616:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789518079.563541:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789518079.564371:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789518079.564395:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518079.564408:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.564435:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518079.564447:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789518079.564450:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789518079.564453:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789518079.565249:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.565264:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.565276:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.565303:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.565381:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.565424:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.565535:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522623744 00000100:00100000:2.0:1789518079.565543:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522623744 00000100:00100000:2.0:1789518079.565599:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789518079.565609:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522623744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518079.565623:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518079.565639:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dce200/0x8d0fd679423142a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231429e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.565842:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dce200/0x8d0fd679423142a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231429e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.565855:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dce200/0x8d0fd679423142a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231429e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.565865:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dce200, rc 0) 00000100:00100000:2.0:1789518079.565920:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522623744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518079.565927:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789518079.566089:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518079.566106:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.566184:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.566261:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.566289:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.566329:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.566484:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522623872 00000100:00100000:3.0:1789518079.566490:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522623872 00000100:00100000:3.0:1789518079.566520:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789518079.566528:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522623872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518079.566847:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522623872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518079.566856:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789518079.567281:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522623872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.567330:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522624000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.567386:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.567412:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.568101:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522624000 00000100:00100000:3.0:1789518079.568111:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522624000 00000100:00100000:3.0:1789518079.568232:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789518079.568243:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522624000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518079.568395:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522624000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518079.568402:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789518079.568563:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522624000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.570100:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10353:1876445522624128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.570266:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.570316:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.570424:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522624128 00000100:00100000:0.0:1789518079.570433:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522624128 00000100:00100000:0.0:1789518079.570522:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789518079.570533:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10353:x1876445522624128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.570968:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10353:x1876445522624128:12345-0@lo:502:llog_process_th.0 Request processed in 436us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.570976:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789518079.571305:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10353:1876445522624128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518079.571457:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518079.571492:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518079.571563:0:10353:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789518079.571637:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789518079.571741:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10353:1876445522624256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518079.571936:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.571978:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405f3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518079.572103:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522624256 00000100:00100000:0.0:1789518079.572110:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522624256 00000100:00100000:0.0:1789518079.572660:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789518079.572672:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10353:x1876445522624256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518079.575199:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10353:x1876445522624256:12345-0@lo:502:llog_process_th.0 Request processed in 2516us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518079.575218:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789518079.575964:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10353:1876445522624256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518079.576237:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518079.576248:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518079.576251:0:10353:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518079.576256:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789518079.577069:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789518079.577100:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789518079.577178:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.577193:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518079.577224:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789518079.577228:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e740dd9cd40 from 1 10000000:01000000:2.0:1789518079.577232:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789518079.577275:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.577283:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518079.577296:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518079.577398:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522624384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.577935:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518079.578044:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518079.578198:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522624384 00000100:00100000:3.0:1789518079.578208:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522624384 00000100:00100000:3.0:1789518079.578298:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789518079.578310:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522624384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518079.578334:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518079.578361:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030e00/0x8d0fd679423142b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423142ac expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.578391:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030e00/0x8d0fd679423142b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423142ac expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.578403:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030e00/0x8d0fd679423142b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142ac expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518079.578413:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030e00, rc 0) 00000100:00100000:3.0:1789518079.578530:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522624384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518079.578537:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789518079.579093:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522624384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518079.579123:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.579146:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423142b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518079.579243:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522624512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518079.579285:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518079.580089:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740393d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518079.580264:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522624512 00000100:00100000:2.0:1789518079.580273:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522624512 00000100:00100000:2.0:1789518079.580329:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789518079.580339:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522624512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518079.580491:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522624512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (1205us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518079.580509:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789518079.580982:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522624512:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789518079.581037:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789518079.581048:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518079.581059:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518080.054015:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518080.696291:0:10390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd70668210 20000000:00000080:3.0:1789518080.696312:0:10390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e7303399c00 uarg=0000000000000000 20000000:01000000:3.0:1789518080.696369:0:10390:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789518080.696375:0:10390:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789518080.696382:0:10390:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789518080.697234:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789518080.697439:0:10390:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789518080.706040:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789518080.706093:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789518080.706111:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789518080.706130:0:10390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789518080.706174:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706197:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e740165d800/0x8d0fd67942313f56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706207:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706281:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706292:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706303:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706311:0:10390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706361:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.706435:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 9 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518080.706455:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522624640:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789518080.707253:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.707280:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518080.707292:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522624768:0@lo:104: 00000100:00100000:1.0:1789518080.707345:0:10390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518080.707400:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.707408:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518080.707417:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522624896:0@lo:104: 00010000:00010000:1.0:1789518080.707443:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.707449:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518080.707457:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522625024:0@lo:104: 00010000:00010000:1.0:1789518080.707516:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e740165d800/0x8d0fd67942313f56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.707524:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e740165d800/0x8d0fd67942313f56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 23 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518080.707533:0:10390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522625152:0@lo:104: 00000100:00100000:1.0:1789518080.707551:0:10390:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403fdad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518080.707860:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518080.707884:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.707928:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.707946:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.707956:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522624768 00000100:00100000:0.0:1789518080.707965:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522624768 00000100:00100000:0.0:1789518080.708017:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522624896 00000100:00100000:0.0:1789518080.708020:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522624896 00000100:00100000:0.0:1789518080.708030:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625024 00000100:00100000:0.0:1789518080.708032:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625024 00000100:00100000:0.0:1789518080.708040:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625152 00000100:00100000:0.0:1789518080.708042:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625152 00000100:00100000:0.0:1789518080.708056:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518080.708076:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f8eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:10390:x1876445522624768:12345-0@lo:104: 00010000:00010000:0.0:1789518080.708093:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708155:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518080.708161:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f8eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+6:10390:x1876445522624768:12345-0@lo:104: Request processed in 88us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.708169:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518080.708228:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518080.708236:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:10390:x1876445522624896:12345-0@lo:104: 00010000:00010000:0.0:1789518080.708245:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708282:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518080.708287:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:10390:x1876445522624896:12345-0@lo:104: Request processed in 53us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.708293:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518080.708305:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518080.708312:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:10390:x1876445522625024:12345-0@lo:104: 00010000:00010000:0.0:1789518080.708319:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708354:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789518080.708359:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:10390:x1876445522625024:12345-0@lo:104: Request processed in 48us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.708364:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518080.708376:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518080.708641:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:10390:x1876445522625152:12345-0@lo:104: 00010000:00010000:0.0:1789518080.708650:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708681:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789518080.708686:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:10390:x1876445522625152:12345-0@lo:104: Request processed in 49us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.708692:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1789518080.708715:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789518080.708722:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708730:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518080.708735:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708745:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518080.708753:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518080.708759:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518080.708793:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708800:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518080.708823:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708840:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d000/0x8d0fd679423140d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423140de expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708858:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789518080.708861:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708867:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518080.708870:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708876:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518080.708882:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518080.708887:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518080.708916:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708921:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518080.708937:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708943:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd67942313fe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313fe9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708952:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518080.708961:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708967:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518080.708970:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.708977:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518080.708984:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518080.708989:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518080.709001:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709007:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518080.709013:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709018:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740165d400/0x8d0fd67942313f5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f64 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709027:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518080.709030:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709034:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518080.709037:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709053:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518080.709059:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518080.709064:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518080.709077:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709082:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518080.709087:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709094:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942313f4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942313f56 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.709107:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518080.709109:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518080.709110:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518080.709116:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518080.709147:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522625536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518080.709183:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.709212:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518080.710313:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522625664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518080.710372:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518080.710438:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518080.710446:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522625280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518080.711811:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625536 00000100:00100000:2.0:1789518080.711824:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625536 00010000:00010000:2.0:1789518080.711867:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 24 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518080.711936:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625664 00000100:00100000:2.0:1789518080.711940:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625664 00010000:00010000:2.0:1789518080.711955:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e740165d800/0x8d0fd67942313f56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 25 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518080.711977:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518080.711986:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3638:x1876445522625536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518080.712002:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518080.712008:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 25 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518080.712020:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 25 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518080.712049:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518080.712065:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522625408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518080.713408:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522624768:0@lo:104: 00000100:00100000:1.0:1789518080.713446:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522624896:0@lo:104: 00010000:00010000:1.0:1789518080.713458:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dce000/0x8d0fd67942313f64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313f5d expref: 25 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518080.713493:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522625024:0@lo:104: 00000100:00100000:1.0:1789518080.713503:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522625152:0@lo:104: 00000100:00100000:3.0:1789518080.713507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.715652:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625280 00000100:00100000:0.0:1789518080.715673:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625280 00010000:00010000:0.0:1789518080.715743:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 25 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518080.715799:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518080.715809:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3639:x1876445522625664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518080.715829:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518080.715836:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e740165d800/0x8d0fd67942313f56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 25 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.715847:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e740165d800/0x8d0fd67942313f56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 25 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.715868:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740165d800/0x8d0fd67942313f56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313f4f expref: 25 pid: 6507 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.715898:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518080.716144:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522625664:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (5770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.716153:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518080.716175:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518080.716181:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:3639:x1876445522625280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518080.716190:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518080.716195:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.716203:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.716215:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423140de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423140d7 expref: 23 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.716246:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518080.716272:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3639:x1876445522625280:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (2766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.716401:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1789518080.716434:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518080.716840:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.717126:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625408 00000100:00100000:0.0:1789518080.717134:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625408 00010000:00010000:0.0:1789518080.717161:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 22 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518080.717180:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518080.717187:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3638:x1876445522625408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518080.717198:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518080.717203:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 22 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.717211:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 22 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.717224:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcf400/0x8d0fd67942313fe9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942313fe2 expref: 22 pid: 6505 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.717238:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518080.717460:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522625408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518080.717717:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3638:x1876445522625408:12345-0@lo:103:ldlm_bl.0 Request processed in 529us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.717725:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518080.718251:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522625280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518080.718262:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522625664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518080.718801:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3638:x1876445522625536:12345-0@lo:103:ldlm_bl.0 Request processed in 6812us (9613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518080.718812:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518080.719261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522625536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518080.720312:0:10390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1876445522624640:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518080.720351:0:10390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518080.724075:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518080.725774:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501594112 00000100:00100000:0.0:1789518080.725817:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501594112 00010000:00010000:0.0:1789518080.725877:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518080.725942:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:0.0:1789518080.725956:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501594112:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518080.726075:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518080.726083:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726098:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726220:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcfa00/0x8d0fd679423141f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fa1 expref: 10 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726245:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726255:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726280:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726289:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726296:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726314:0:9516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726320:0:9516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518080.726325:0:9516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.726335:0:9516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.737373:0:10390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518080.737458:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.738069:0:9516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.738084:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d600/0x8d0fd679423142ba lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518080.738182:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518080.739823:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:395607ea-c3c4-4708-8905-dac70dffbbe5+9:2387:x1876445501594112:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 13855us (15746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.739840:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:1.0:1789518080.971335:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518080.973401:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501594240 00000100:00100000:2.0:1789518080.973420:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501594240 00000100:00100000:2.0:1789518080.973529:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 250 00000100:00100000:2.0:1789518080.973542:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+9:6162:x1876445501594240:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518080.973562:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518080.973596:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565fe7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518080.973635:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518080.973648:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518080.973660:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf400, rc 0) 00000100:00100000:2.0:1789518080.973763:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501594240:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 223us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518080.973771:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 250 00000100:00100000:2.0:1789518081.000726:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518081.000815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501594368 00000100:00100000:3.0:1789518081.000841:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501594368 00000100:00100000:3.0:1789518081.000917:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 251 00000100:00100000:3.0:1789518081.000930:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501594368:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.001147:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501594368:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518081.001156:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 251 00000100:00100000:1.0:1789518081.015412:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518081.015520:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501594496 00000100:00100000:3.0:1789518081.015534:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501594496 00000100:00100000:3.0:1789518081.015604:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 252 00000100:00100000:3.0:1789518081.015616:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501594496:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.015816:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6162:x1876445501594496:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 201us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518081.015825:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 252 00000100:00100000:0.0:1789518081.026002:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518081.027313:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501594624 00000100:00100000:3.0:1789518081.027332:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501594624 00000100:00100000:3.0:1789518081.027420:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 253 00000100:00100000:3.0:1789518081.027433:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6673:x1876445501594624:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518081.027857:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6673:x1876445501594624:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 268us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518081.027867:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 253 00000100:00100000:1.0:1789518081.051076:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518081.051137:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501594752 00000100:00100000:1.0:1789518081.051152:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501594752 00000100:00100000:1.0:1789518081.051221:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 254 00000100:00100000:1.0:1789518081.051234:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6673:x1876445501594752:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518081.051924:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:6673:x1876445501594752:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 689us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.051936:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 254 00010000:00010000:1.0:1789518081.079148:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518081.525725:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522625792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518081.525845:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518081.528121:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625792 00000100:00100000:3.0:1789518081.528142:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625792 00000100:00080000:2.0:1789518081.528225:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518081.528266:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518081.528356:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522625792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518081.528392:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518081.528535:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522625792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 258us (2689us total) trans 0 rc 0/0 00010000:00080000:1.0:1789518081.529299:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303546300 x1876445522625792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518081.529326:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522625792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518081.549175:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 10000000:01000000:0.0:1789518081.589620:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518081.589630:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e730205a000 from 4 10000000:01000000:0.0:1789518081.589638:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518081.589718:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.589745:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.589782:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518081.589818:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522625920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.589928:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.590010:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518081.590333:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522625920 00000100:00100000:3.0:1789518081.590345:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522625920 00000100:00100000:3.0:1789518081.590426:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789518081.590438:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522625920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518081.590456:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518081.590525:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423142c8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518081.590554:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518081.590567:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518081.590576:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:3.0:1789518081.590627:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522625920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518081.590634:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789518081.590907:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522625920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518081.590928:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.590937:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518081.591766:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.591823:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518081.591872:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.591946:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626048 00000100:00100000:0.0:1789518081.591953:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626048 00000100:00100000:0.0:1789518081.592002:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789518081.592011:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522626048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518081.593978:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522626048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1956us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518081.593995:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789518081.594185:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.594259:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.594336:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518081.594556:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.595435:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626176 00000100:00100000:0.0:1789518081.595448:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626176 00000100:00100000:0.0:1789518081.595524:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789518081.595533:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522626176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.595698:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522626176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518081.595706:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789518081.596455:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.597180:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10411:1876445522626304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518081.597250:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518081.597294:0:10411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518081.597404:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626304 00000100:00100000:2.0:1789518081.597412:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626304 00000100:00100000:2.0:1789518081.597449:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789518081.597456:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10411:x1876445522626304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518081.597605:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10411:x1876445522626304:12345-0@lo:502:llog_process_th.0 Request processed in 149us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518081.597615:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789518081.597802:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10411:1876445522626304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518081.597830:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518081.597843:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518081.597846:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789518081.597855:0:10411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e730205a000 00000020:00000080:3.0:1789518081.597858:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518081.597997:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10411:1876445522626432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518081.598039:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518081.598062:0:10411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.598116:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626432 00000100:00100000:0.0:1789518081.598121:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626432 00000100:00100000:0.0:1789518081.598168:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789518081.598174:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10411:x1876445522626432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.598252:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:10411:x1876445522626432:12345-0@lo:502:llog_process_th.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518081.598260:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789518081.598329:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10411:1876445522626432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518081.598343:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518081.598346:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518081.598348:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789518081.598351:0:10411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789518081.598665:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789518081.598707:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518081.598720:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.598733:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518081.598746:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518081.598750:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7435dc1800 from 4 10000000:01000000:0.0:1789518081.598753:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518081.598788:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.598797:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.598808:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518081.598825:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.598876:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.598931:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518081.599046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626560 00000100:00100000:2.0:1789518081.599053:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626560 00000100:00100000:2.0:1789518081.599092:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789518081.599099:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522626560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518081.599118:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518081.599133:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423142d6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518081.599158:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518081.599169:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518081.599180:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf800, rc 0) 00000100:00100000:2.0:1789518081.599221:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522626560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518081.599227:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789518081.599261:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518081.599274:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518081.599283:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518081.599743:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.599780:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518081.599844:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518081.599875:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626688 00000100:00100000:2.0:1789518081.599879:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626688 00000100:00100000:2.0:1789518081.599942:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789518081.599949:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522626688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518081.600074:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522626688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518081.600081:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789518081.600162:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.600205:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.600245:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.600617:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518081.600647:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626816 00000100:00100000:3.0:1789518081.600653:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626816 00000100:00100000:3.0:1789518081.600678:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789518081.600686:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522626816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518081.600786:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522626816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518081.600793:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789518081.600840:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522626816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518081.617772:0:10413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10413:1876445522626944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518081.617894:0:10413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518081.617958:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522626944 00000100:00100000:2.0:1789518081.617967:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522626944 00000100:00100000:2.0:1789518081.618026:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789518081.618034:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10413:x1876445522626944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518081.618182:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10413:x1876445522626944:12345-0@lo:502:llog_process_th.0 Request processed in 148us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518081.618189:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789518081.618526:0:10413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302212540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.618552:0:10413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10413:1876445522626944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518081.618592:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518081.618605:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518081.618609:0:10413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518081.618618:0:10413:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7435dc1800 00000020:00000080:0.0:1789518081.618620:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789518081.619141:0:10413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10413:1876445522627072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.619188:0:10413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.620120:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627072 00000100:00100000:0.0:1789518081.620136:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627072 00000100:00100000:0.0:1789518081.620179:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789518081.620193:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10413:x1876445522627072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.620488:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:10413:x1876445522627072:12345-0@lo:502:llog_process_th.0 Request processed in 295us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518081.620495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789518081.620542:0:10413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.620564:0:10413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10413:1876445522627072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518081.620593:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518081.620601:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518081.620604:0:10413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789518081.620609:0:10413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789518081.621337:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789518081.621407:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518081.621422:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.621436:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518081.621449:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518081.621453:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e74044cd800 from 4 10000000:01000000:1.0:1789518081.621457:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518081.621523:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.621533:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.621545:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518081.621575:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518081.621666:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518081.621723:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518081.621753:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627200 00000100:00100000:1.0:1789518081.621761:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627200 00000100:00100000:1.0:1789518081.621843:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789518081.621855:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522627200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518081.621870:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518081.621897:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423142e4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.621925:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.621948:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.621957:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d000, rc 0) 00000100:00100000:1.0:1789518081.622021:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522627200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.622031:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789518081.622064:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518081.622102:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.622117:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518081.622201:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.623488:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.623540:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031dfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518081.627396:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627328 00000100:00100000:1.0:1789518081.627415:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627328 00000100:00100000:1.0:1789518081.627510:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789518081.627524:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522627328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518081.627713:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522627328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.627723:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789518081.627817:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.627907:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.628023:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.628071:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031dfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518081.629129:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627456 00000100:00100000:1.0:1789518081.629144:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627456 00000100:00100000:1.0:1789518081.629591:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789518081.629603:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522627456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518081.629752:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522627456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.629766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789518081.634438:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.635046:0:10417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10417:1876445522627584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.635142:0:10417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.635194:0:10417:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031dfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518081.635314:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627584 00000100:00100000:1.0:1789518081.635323:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627584 00000100:00100000:1.0:1789518081.635378:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789518081.635389:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10417:x1876445522627584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518081.635560:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10417:x1876445522627584:12345-0@lo:502:llog_process_th.0 Request processed in 172us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.635569:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789518081.635737:0:10417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10417:1876445522627584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518081.635766:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518081.635777:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518081.635780:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518081.635790:0:10417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e74044cd800 00000020:00000080:0.0:1789518081.635792:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789518081.635899:0:10417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10417:1876445522627712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.635935:0:10417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.635968:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627712 00000100:00100000:0.0:1789518081.635972:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627712 00000100:00100000:0.0:1789518081.635993:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789518081.636000:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10417:x1876445522627712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.636064:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:10417:x1876445522627712:12345-0@lo:502:llog_process_th.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518081.636070:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789518081.636098:0:10417:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031dfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.636110:0:10417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10417:1876445522627712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518081.636127:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518081.636131:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518081.636133:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789518081.636137:0:10417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789518081.636865:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789518081.636910:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518081.636923:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.636938:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518081.636953:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518081.636956:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7439644800 from 4 10000000:01000000:1.0:1789518081.636960:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518081.636998:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.637008:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.637018:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518081.637037:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518081.637086:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518081.637115:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518081.638340:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627840 00000100:00100000:2.0:1789518081.638352:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627840 00000100:00100000:2.0:1789518081.638421:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789518081.638432:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522627840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518081.638448:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518081.638487:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423142f2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518081.638518:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518081.638530:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518081.638540:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dce000, rc 0) 00000100:00100000:2.0:1789518081.638608:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522627840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518081.638615:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789518081.640822:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518081.640866:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518081.640894:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518081.641012:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518081.641092:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518081.641142:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522627968 00000100:00100000:1.0:1789518081.641149:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522627968 00000100:00100000:1.0:1789518081.641196:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789518081.644064:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518081.645020:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522627968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518081.648405:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522627968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7181us (7294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.648427:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789518081.655019:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522627968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.655239:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522628096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.657458:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.657534:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628096 00000100:00100000:0.0:1789518081.657544:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628096 00000100:00100000:0.0:1789518081.657597:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789518081.657607:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522628096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.657754:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522628096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518081.657762:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789518081.657826:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031dfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.657848:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522628096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518081.658106:0:10419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10419:1876445522628224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.658145:0:10419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.658166:0:10419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031dfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518081.658588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628224 00000100:00100000:1.0:1789518081.658594:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628224 00000100:00100000:1.0:1789518081.658625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789518081.658632:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:10419:x1876445522628224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518081.658720:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:10419:x1876445522628224:12345-0@lo:502:llog_process_th.0 Request processed in 87us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.658727:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789518081.658956:0:10419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10419:1876445522628224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518081.658984:0:10419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518081.658999:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518081.659002:0:10419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518081.659010:0:10419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7439644800 00000020:00000080:0.0:1789518081.659013:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789518081.659111:0:10419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10419:1876445522628352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.659151:0:10419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518081.659176:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628352 00000100:00100000:0.0:1789518081.659180:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628352 00000100:00100000:0.0:1789518081.659205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789518081.659210:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:10419:x1876445522628352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518081.659276:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:10419:x1876445522628352:12345-0@lo:502:llog_process_th.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518081.659283:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789518081.659333:0:10419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031dfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518081.659345:0:10419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:10419:1876445522628352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518081.659363:0:10419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518081.659368:0:10419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518081.659369:0:10419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789518081.659373:0:10419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789518081.659441:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789518081.659485:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518081.659502:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518081.659514:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518082.102815:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518083.063607:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522628864:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.063708:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518083.063803:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522629376:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.063833:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518083.063862:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522629888:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.063900:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518083.063930:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789518083.063938:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522628736:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.063985:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518083.064008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522629248:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064034:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518083.064056:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522629760:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064077:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518083.064115:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628864 00000100:00100000:0.0:1789518083.064126:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628864 00000100:00100000:0.0:1789518083.064206:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789518083.064217:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522628864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064281:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522628864:12345-0@lo:400:kworker.0 Request processed in 66us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518083.064290:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789518083.064331:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522629376 00000100:00100000:0.0:1789518083.064336:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522629376 00000100:00100000:0.0:1789518083.064371:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522629888 00000100:00100000:0.0:1789518083.064373:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522629888 00000100:00100000:0.0:1789518083.064386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628736 00000100:00100000:0.0:1789518083.064388:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628736 00000100:00100000:0.0:1789518083.064400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522629760 00000100:00100000:0.0:1789518083.064402:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522629760 00000100:00100000:0.0:1789518083.064417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789518083.064422:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522629376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064454:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522629376:12345-0@lo:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518083.064459:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789518083.064500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518083.064507:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522629888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064534:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522629888:12345-0@lo:400:kworker.0 Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518083.064540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518083.064551:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518083.064557:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522628736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064585:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522628736:12345-0@lo:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518083.064590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518083.064601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518083.064608:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522629760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064635:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522629760:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518083.064651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518083.064683:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522629248 00000100:00100000:0.0:1789518083.064686:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522629248 00000100:00100000:0.0:1789518083.064715:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518083.064721:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522629248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064753:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522629248:12345-0@lo:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518083.064759:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789518083.064785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518083.064790:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518083.064793:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518083.064829:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522628736:0@lo:400:kworker.0 00010000:00080000:0.0:1789518083.064844:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880380 x1876445522629248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518083.064855:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522629248:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.064864:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522629760:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065036:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522628480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518083.065080:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065110:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522628992:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065132:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065151:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522629504:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065193:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522630016:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065215:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065240:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789518083.065247:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522628608:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065306:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522629120:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065329:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065350:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522629632:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065371:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065389:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522630144:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065409:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518083.065438:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630016 00000100:00100000:1.0:1789518083.065443:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630016 00000100:00100000:1.0:1789518083.065519:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522629632 00000100:00100000:1.0:1789518083.065522:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522629632 00000100:00100000:1.0:1789518083.065537:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630144 00000100:00100000:1.0:1789518083.065540:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630144 00000100:00100000:1.0:1789518083.065555:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518083.065560:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522630016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065603:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522630016:12345-0@lo:400:kworker.0 Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.065620:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518083.065634:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518083.065641:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522629632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065671:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522629632:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.065676:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518083.065686:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518083.065692:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522630144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065717:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522630144:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.065722:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518083.065741:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628480 00000100:00100000:1.0:1789518083.065744:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628480 00000100:00100000:1.0:1789518083.065770:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518083.065777:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522628480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518083.065803:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518083.065833:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522628480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.065839:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518083.065861:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522629120 00000100:00100000:1.0:1789518083.065865:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522629120 00000100:00100000:1.0:1789518083.065905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518083.065911:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522629120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.065941:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522629120:12345-0@lo:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.065958:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518083.065987:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628992 00000100:00100000:1.0:1789518083.065990:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628992 00000100:00100000:1.0:1789518083.066013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522629504 00000100:00100000:1.0:1789518083.066016:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522629504 00000100:00100000:1.0:1789518083.066036:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789518083.066043:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522628992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.066076:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522628992:12345-0@lo:400:kworker.0 Request processed in 34us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.066082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789518083.066093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789518083.066099:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522629504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.066125:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522629504:12345-0@lo:400:kworker.0 Request processed in 27us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.066131:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789518083.066170:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522629120:0@lo:400:kworker.0 00010000:00080000:1.0:1789518083.066183:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f883100 x1876445522629632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518083.066193:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522629632:0@lo:400:kworker.0 00010000:00080000:1.0:1789518083.066202:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f82a00 x1876445522630144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518083.066210:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522630144:0@lo:400:kworker.0 00010000:00080000:1.0:1789518083.066220:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303558380 x1876445522628480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518083.066247:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522628480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518083.066262:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522628992:0@lo:400:kworker.0 00010000:00080000:1.0:1789518083.066270:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881880 x1876445522629504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518083.066278:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522629504:0@lo:400:kworker.0 00010000:00080000:1.0:1789518083.066287:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f883480 x1876445522630016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518083.066294:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522630016:0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.066359:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522628608 00000100:00100000:1.0:1789518083.066364:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522628608 00000100:00100000:1.0:1789518083.066393:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789518083.066400:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522628608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518083.066438:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522628608:12345-0@lo:400:kworker.0 Request processed in 38us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518083.066445:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:1.0:1789518083.066497:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518083.066502:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518083.066504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518083.066522:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522628608:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.074919:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522628864:0@lo:400:kworker.0 00000100:00100000:0.0:1789518083.074940:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522629376:0@lo:400:kworker.0 00010000:00080000:0.0:1789518083.074957:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881500 x1876445522629888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518083.074969:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522629888:0@lo:400:kworker.0 00010000:00010000:2.0:1789518083.128082:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518083.581777:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522630272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518083.581861:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518083.581962:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630272 00000100:00100000:2.0:1789518083.581973:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630272 00000100:00100000:2.0:1789518083.582031:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518083.582043:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522630272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518083.582073:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518083.582125:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522630272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518083.582132:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789518083.589931:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303546680 x1876445522630272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518083.589969:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522630272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518084.009779:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518084.009832:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518084.009988:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595008 00000100:00100000:0.0:1789518084.010000:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595008 00000100:00100000:0.0:1789518084.010097:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:0.0:1789518084.010109:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2389:x1876445501595008:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518084.010198:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2389:x1876445501595008:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 91us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518084.010205:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00080000:3.0:1789518084.010740:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518084.011557:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518084.011605:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518084.011733:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501594880 00000100:00100000:0.0:1789518084.011743:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501594880 00000100:00100000:0.0:1789518084.011803:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 276 00000100:00100000:0.0:1789518084.011813:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2389:x1876445501594880:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518084.011888:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2389:x1876445501594880:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518084.011896:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 276 00000100:00100000:1.0:1789518084.012161:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518084.018877:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595136 00000100:00100000:3.0:1789518084.018894:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595136 00000100:00100000:3.0:1789518084.019251:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:3.0:1789518084.019267:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501595136:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518084.019519:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501595136:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 254us (7911us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518084.019757:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518084.020275:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:2.0:1789518084.025749:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595264 00000100:00100000:2.0:1789518084.025783:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595264 00000100:00100000:1.0:1789518084.026573:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595392 00000100:00100000:1.0:1789518084.026581:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595392 00000100:00100000:1.0:1789518084.026628:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:1.0:1789518084.026639:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501595264:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518084.026748:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501595264:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 101us (16905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518084.026756:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:1.0:1789518084.026784:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:1.0:1789518084.026790:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501595392:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518084.026818:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501595392:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (14658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518084.026824:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00080000:3.0:1789518084.027769:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518084.027776:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518084.085833:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522630400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518084.085945:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518084.086125:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630400 00000100:00100000:0.0:1789518084.086134:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630400 00000100:00100000:0.0:1789518084.086191:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518084.086201:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522630400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518084.086240:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518084.086294:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522630400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518084.086302:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518084.086520:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522630400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518084.087057:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522630528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518084.087224:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518084.087369:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630528 00000100:00100000:0.0:1789518084.087378:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630528 00000100:00100000:0.0:1789518084.087447:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518084.087459:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522630528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518084.087539:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518084.087590:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522630528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518084.087597:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789518084.087942:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f81c00 x1876445522630528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518084.087965:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522630528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518084.089279:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522630656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518084.089371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518084.089428:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630656 00000100:00100000:3.0:1789518084.089441:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630656 00000100:00100000:2.0:1789518084.097883:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789518084.097908:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522630656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518084.097961:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518084.098188:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522630656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 291us (8818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518084.098196:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518084.106339:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522630656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789518084.151346:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518085.174961:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518086.205638:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518086.647526:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522630784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518086.647814:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518086.647929:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630784 00000100:00100000:1.0:1789518086.647941:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630784 00000100:00100000:1.0:1789518086.648033:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789518086.648048:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522630784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789518086.648084:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518086.648178:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522630784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518086.648185:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789518086.648209:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518086.649829:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881500 x1876445522630784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518086.649875:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522630784:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789518087.222811:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518088.189306:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522630912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518088.189398:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518088.189750:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522630912 00000100:00100000:3.0:1789518088.189764:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522630912 00000100:00100000:3.0:1789518088.189848:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518088.189868:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522630912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518088.189904:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518088.189961:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522630912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518088.189967:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789518088.190013:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303559180 x1876445522630912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518088.190032:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522630912:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789518088.191633:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518088.194140:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730355bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522631424:0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.194221:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518088.194267:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522631936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.194289:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518088.194306:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522632448:0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.194329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518088.194360:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789518088.194366:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522631296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.197696:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522631168:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.197781:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518088.197838:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522631680:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.197872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518088.197908:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522632192:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.197945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518088.197985:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789518088.197993:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522631040:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198020:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518088.198041:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522631552:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198064:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518088.198084:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522632064:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198105:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518088.198143:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631424 00000100:00100000:1.0:1789518088.198154:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631424 00000100:00100000:1.0:1789518088.198198:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631936 00000100:00100000:1.0:1789518088.198200:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631936 00000100:00100000:1.0:1789518088.198222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631168 00000100:00100000:1.0:1789518088.198224:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631168 00000100:00100000:1.0:1789518088.198233:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632192 00000100:00100000:1.0:1789518088.198235:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632192 00000100:00100000:1.0:1789518088.198249:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789518088.198257:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522631424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198307:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522631424:12345-0@lo:400:kworker.0 Request processed in 51us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518088.198315:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789518088.198340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789518088.198345:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522631936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198369:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522631936:12345-0@lo:400:kworker.0 Request processed in 25us (4080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518088.198375:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789518088.198383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518088.198388:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522631168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198429:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522631168:12345-0@lo:400:kworker.0 Request processed in 40us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518088.198435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518088.198446:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518088.198452:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522632192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198569:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522632192:12345-0@lo:400:kworker.0 Request processed in 49us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518088.198577:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518088.198596:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632448 00000100:00100000:1.0:1789518088.198600:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632448 00000100:00100000:1.0:1789518088.198627:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631680 00000100:00100000:1.0:1789518088.198630:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631680 00000100:00100000:1.0:1789518088.198643:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632064 00000100:00100000:1.0:1789518088.198645:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632064 00000100:00100000:1.0:1789518088.198656:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518088.198661:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522632448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198693:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522632448:12345-0@lo:400:kworker.0 Request processed in 32us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518088.198699:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518088.198709:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518088.198721:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b59e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522631680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.198751:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b59e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522631680:12345-0@lo:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518088.198756:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518088.205021:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518088.205040:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522632064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.205135:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522632064:12345-0@lo:400:kworker.0 Request processed in 102us (7029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518088.205144:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518088.205300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518088.205334:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522631808:0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.205368:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518088.205408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522632320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.205430:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518088.205452:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631808 00000100:00100000:3.0:1789518088.205482:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631808 00000100:00100000:3.0:1789518088.205527:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632320 00000100:00100000:3.0:1789518088.205531:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632320 00000100:00100000:3.0:1789518088.205553:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789518088.205560:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522631808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.205592:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522631808:12345-0@lo:400:kworker.0 Request processed in 32us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518088.205598:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789518088.205612:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789518088.205618:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522632320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.205641:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522632320:12345-0@lo:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518088.205647:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789518088.205679:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404813100 x1876445522632320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518088.205693:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522632320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.205705:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730355bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522631424:0@lo:400:kworker.0 00010000:00080000:3.0:1789518088.205716:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404812a00 x1876445522631936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518088.205723:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522631936:0@lo:400:kworker.0 00010000:00080000:3.0:1789518088.205732:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404810a80 x1876445522632448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518088.205752:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522632448:0@lo:400:kworker.0 00000100:00100000:3.0:1789518088.205782:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522631808:0@lo:400:kworker.0 00000100:00100000:2.0:1789518088.205969:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631552 00000100:00100000:2.0:1789518088.205975:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631552 00000100:00100000:2.0:1789518088.206007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631296 00000100:00100000:2.0:1789518088.206009:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631296 00000100:00100000:2.0:1789518088.206024:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789518088.206030:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518088.206071:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522631552:12345-0@lo:400:kworker.0 Request processed in 41us (8007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518088.206078:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789518088.206091:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789518088.206096:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522631296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518088.206126:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522631296:12345-0@lo:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518088.206132:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789518088.206159:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522631296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.206710:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522631040 00000100:00100000:1.0:1789518088.206717:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522631040 00000100:00100000:1.0:1789518088.206753:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789518088.206760:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522631040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518088.206800:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522631040:12345-0@lo:400:kworker.0 Request processed in 41us (8779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518088.206806:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789518088.210028:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522631040:0@lo:400:kworker.0 00000100:00100000:2.0:1789518088.210055:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522631552:0@lo:400:kworker.0 00010000:00080000:2.0:1789518088.210073:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811f80 x1876445522632064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518088.210085:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522632064:0@lo:400:kworker.0 00000100:00100000:2.0:1789518088.210098:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522631168:0@lo:400:kworker.0 00010000:00080000:2.0:1789518088.210110:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811880 x1876445522631680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518088.210147:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522631680:0@lo:400:kworker.0 00000100:00100000:2.0:1789518088.210161:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522632192:0@lo:400:kworker.0 00000100:00080000:2.0:1789518088.210217:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518088.210223:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518088.210227:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518088.210230:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789518088.245654:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518088.277944:0:10690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789518088.694090:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522632576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518088.694172:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518088.694305:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632576 00000100:00100000:2.0:1789518088.694313:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632576 00000100:00100000:2.0:1789518088.694364:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518088.694374:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522632576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518088.694402:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518088.694448:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522632576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518088.694456:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789518088.694541:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303545f80 x1876445522632576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518088.694561:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522632576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518089.110075:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518089.110986:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518089.111019:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518089.111042:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518089.113587:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595904 00000100:00100000:2.0:1789518089.113608:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595904 00000100:00100000:2.0:1789518089.113690:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:2.0:1789518089.113702:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501595904:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518089.113803:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501595904:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 103us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518089.113921:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00080000:2.0:1789518089.113950:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518089.115235:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518089.115278:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595520 00000100:00100000:3.0:1789518089.115286:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595520 00000100:00100000:3.0:1789518089.115335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 278 00000100:00100000:3.0:1789518089.115345:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501595520:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518089.115821:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501595520:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 466us (4789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518089.115830:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 278 00000100:00100000:3.0:1789518089.115884:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596032 00000100:00100000:3.0:1789518089.115888:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596032 00000100:00100000:3.0:1789518089.115925:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:3.0:1789518089.115932:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501596032:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518089.115967:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501596032:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 35us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518089.115973:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00080000:3.0:1789518089.116096:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518089.119996:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595648 00000100:00100000:0.0:1789518089.120014:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595648 00000100:00100000:0.0:1789518089.120103:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501595776 00000100:00100000:0.0:1789518089.120107:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501595776 00000100:00100000:0.0:1789518089.120141:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:0.0:1789518089.120152:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501595648:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518089.120242:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501595648:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 92us (10177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518089.120250:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:0.0:1789518089.120268:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:0.0:1789518089.120275:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501595776:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518089.120300:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501595776:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (9258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518089.120306:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00080000:1.0:1789518089.123132:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518089.123142:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518089.207824:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518089.207865:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522632704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518089.207959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518089.208654:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632704 00000100:00100000:2.0:1789518089.208665:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632704 00000100:00100000:2.0:1789518089.208766:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789518089.208777:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522632704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518089.208827:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789518089.208903:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522632704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518089.208911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789518089.208971:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522632832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518089.209009:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518089.209070:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518089.209077:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522632960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518089.209105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518089.209180:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522632704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518089.213206:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632960 00000100:00100000:2.0:1789518089.213225:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632960 00000100:00100000:2.0:1789518089.213301:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518089.213312:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522632960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518089.213359:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518089.213639:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522632960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 328us (4531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518089.213647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518089.213690:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522632832 00000100:00100000:2.0:1789518089.213695:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522632832 00000100:00100000:2.0:1789518089.213728:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518089.213735:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522632832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518089.213759:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518089.213791:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522632832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518089.213824:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789518089.214132:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522632960:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1789518089.214151:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f80a80 x1876445522632832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518089.214165:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522632832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789518089.275951:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518090.293718:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518091.317836:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518091.770414:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518091.770440:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522633088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518091.770529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518091.770693:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633088 00000100:00100000:0.0:1789518091.770703:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633088 00000100:00100000:0.0:1789518091.770758:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518091.770768:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522633088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789518091.770810:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518091.770857:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522633088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518091.770865:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789518091.771525:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518091.773578:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880a80 x1876445522633088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518091.773606:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522633088:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789518092.345310:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518093.303135:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522633216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518093.303212:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518093.303328:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633216 00000100:00100000:3.0:1789518093.303339:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633216 00000100:00100000:3.0:1789518093.303413:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518093.303426:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522633216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518093.303488:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518093.303547:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522633216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518093.303555:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789518093.303623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789518093.303655:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811880 x1876445522633216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518093.303676:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522633216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518093.304095:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522633600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304159:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304203:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522634112:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304252:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522634624:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304289:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789518093.304295:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522633728:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304315:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304331:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522634240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304351:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304375:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522634752:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304399:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304551:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522633344:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.304583:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633600 00000100:00100000:0.0:1789518093.304583:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518093.304591:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633600 00000100:00100000:0.0:1789518093.304611:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522633856:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304644:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304659:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522634368:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304677:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304695:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789518093.304701:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522633472:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.304718:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633856 00000100:00100000:0.0:1789518093.304720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518093.304721:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633856 00000100:00100000:0.0:1789518093.304732:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522633984:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.304737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518093.304744:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522633600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304749:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304765:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522634496:0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.304819:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522634112 00000100:00100000:0.0:1789518093.304822:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522634112 00000100:00100000:3.0:1789518093.304849:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522633600:12345-0@lo:400:kworker.0 Request processed in 104us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518093.304853:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522634624 00000100:00100000:0.0:1789518093.304855:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522634624 00000100:00100000:3.0:1789518093.304856:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789518093.304866:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633728 00000100:00100000:0.0:1789518093.304869:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633728 00000100:00100000:3.0:1789518093.304870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518093.304875:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522633856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.304879:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522634240 00000100:00100000:0.0:1789518093.304880:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522634240 00000100:00100000:0.0:1789518093.304890:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633472 00000100:00100000:0.0:1789518093.304892:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633472 00000100:00100000:0.0:1789518093.304901:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522634496 00000100:00100000:0.0:1789518093.304903:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522634496 00000100:00100000:3.0:1789518093.304916:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522633856:12345-0@lo:400:kworker.0 Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518093.304917:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789518093.304923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518093.304929:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522634112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.304948:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522634752 00000100:00100000:3.0:1789518093.304951:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522634752 00000100:00100000:0.0:1789518093.304959:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522634112:12345-0@lo:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518093.304964:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789518093.304972:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522634368 00000100:00100000:3.0:1789518093.304975:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522634368 00000100:00100000:0.0:1789518093.304975:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518093.304980:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522634624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.304987:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633984 00000100:00100000:3.0:1789518093.304989:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633984 00000100:00100000:3.0:1789518093.305003:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518093.305004:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522634624:12345-0@lo:400:kworker.0 Request processed in 24us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518093.305008:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522634752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.305009:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518093.305020:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789518093.305026:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522633728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305033:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522634752:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518093.305039:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518093.305047:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522633728:12345-0@lo:400:kworker.0 Request processed in 22us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518093.305048:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518093.305053:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789518093.305054:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522634368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.305062:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789518093.305066:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522634240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305077:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522634368:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518093.305083:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518093.305087:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522634240:12345-0@lo:400:kworker.0 Request processed in 21us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518093.305092:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518093.305092:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789518093.305097:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.305100:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789518093.305105:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522633472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305122:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522633984:12345-0@lo:400:kworker.0 Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518093.305122:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522633472:12345-0@lo:400:kworker.0 Request processed in 18us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518093.305128:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518093.305128:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789518093.305138:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789518093.305149:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522634496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518093.305175:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522634496:12345-0@lo:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518093.305180:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789518093.305248:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522633472:0@lo:400:kworker.0 00010000:00080000:3.0:1789518093.305264:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f81180 x1876445522633984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518093.305279:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522633984:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305290:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522634496:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305297:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522633856:0@lo:400:kworker.0 00010000:00080000:3.0:1789518093.305306:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f80a80 x1876445522634368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518093.305313:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522634368:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305345:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522633728:0@lo:400:kworker.0 00010000:00080000:3.0:1789518093.305355:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f83800 x1876445522634240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518093.305363:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522634240:0@lo:400:kworker.0 00010000:00080000:3.0:1789518093.305371:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f82a00 x1876445522634752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518093.305379:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522634752:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305387:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522633600:0@lo:400:kworker.0 00000100:00100000:3.0:1789518093.305395:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522634112:0@lo:400:kworker.0 00010000:00080000:3.0:1789518093.305402:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f81c00 x1876445522634624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518093.305410:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522634624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518093.308891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522633344 00000100:00100000:1.0:1789518093.308908:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522633344 00000100:00100000:1.0:1789518093.308982:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789518093.308994:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522633344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518093.309096:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522633344:12345-0@lo:400:kworker.0 Request processed in 105us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518093.309104:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1789518093.309883:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518093.309891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518093.309894:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518093.309898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518093.311618:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522633344:0@lo:400:kworker.0 00010000:00010000:2.0:1789518093.375753:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518093.638417:0:10934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing yml_node 00000100:00100000:1.0:1789518093.821173:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518093.821197:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522634880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518093.821270:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518093.821874:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522634880 00000100:00100000:0.0:1789518093.821886:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522634880 00000100:00100000:1.0:1789518093.821994:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518093.822005:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522634880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518093.822032:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518093.822098:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522634880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518093.822106:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789518093.824385:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881880 x1876445522634880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518093.824415:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522634880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518094.234517:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518094.234565:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518094.234567:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596160 00000100:00100000:2.0:1789518094.234579:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596160 00000100:00100000:3.0:1789518094.234601:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518094.234717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 280 00000100:00100000:2.0:1789518094.234728:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501596160:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518094.234794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596416 00000100:00100000:3.0:1789518094.234800:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596416 00000100:00100000:3.0:1789518094.234843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596288 00000100:00100000:3.0:1789518094.234846:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596288 00000100:00100000:3.0:1789518094.234874:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:3.0:1789518094.234883:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501596416:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518094.235003:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:1.0:1789518094.235013:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501596288:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518094.235236:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501596160:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 508us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518094.235245:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 280 00000100:00100000:3.0:1789518094.238198:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501596416:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 3304us (3620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.238217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00080000:3.0:1789518094.238261:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518094.238268:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518094.238332:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518094.238573:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518094.239257:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596544 00000100:00100000:3.0:1789518094.239269:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596544 00000100:00100000:3.0:1789518094.239324:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596672 00000100:00100000:3.0:1789518094.239327:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596672 00000100:00100000:3.0:1789518094.239356:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:1.0:1789518094.241144:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501596288:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 6121us (6531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518094.241160:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:3.0:1789518094.243133:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2386:x1876445501596544:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:3.0:1789518094.243185:0:9982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231420b 00000100:00080000:3.0:1789518094.243199:0:9982:0:(import.c:65:import_set_state_nolock()) ffff8e73034e5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518094.243270:0:9982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789518094.243459:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+2:2386:x1876445501596544:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 4090us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.243490:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789518094.243519:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:3.0:1789518094.243531:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2386:x1876445501596672:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:3.0:1789518094.243545:0:9982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314212 00000100:00080000:3.0:1789518094.243552:0:9982:0:(import.c:65:import_set_state_nolock()) ffff8e743f889800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518094.243578:0:9982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789518094.243653:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+2:2386:x1876445501596672:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 126us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.243801:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00080000:3.0:1789518094.243825:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518094.243829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518094.243893:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518094.244035:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518094.326097:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518094.326123:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522635008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518094.326196:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518094.326283:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635008 00000100:00100000:3.0:1789518094.326293:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635008 00000100:00100000:3.0:1789518094.326345:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518094.326354:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522635008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518094.326397:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518094.326442:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522635008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.326449:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789518094.326517:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404812a00 x1876445522635008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518094.326553:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522635008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518094.326824:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518094.326835:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522635136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518094.326868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518094.327251:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635136 00000100:00100000:3.0:1789518094.327257:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635136 00000100:00100000:3.0:1789518094.327299:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518094.327308:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522635136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518094.327333:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518094.327387:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522635136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.327392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518094.327425:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522635136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518094.331489:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518094.331515:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522635264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518094.331585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518094.332001:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635264 00000100:00100000:1.0:1789518094.332012:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635264 00000100:00100000:1.0:1789518094.332055:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789518094.332066:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522635264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518094.332106:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518094.332168:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522635264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518094.332176:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789518094.332234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522635264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789518094.390759:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518095.413692:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518096.438263:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518096.886101:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518096.886134:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522635392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518096.886222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518096.886503:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635392 00000100:00100000:1.0:1789518096.886512:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635392 00000100:00100000:1.0:1789518096.886626:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518096.886637:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522635392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789518096.886681:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518096.886727:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522635392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518096.886735:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789518096.889988:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f883100 x1876445522635392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518096.890023:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522635392:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789518096.895994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518097.461848:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518098.422065:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522635904:0@lo:400:kworker.0 00000100:00100000:1.0:1789518098.422067:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522635648:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.422333:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522635520:0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.422382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522635776:0@lo:400:kworker.0 00000100:00100000:1.0:1789518098.428866:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518098.430198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518098.430264:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522636032:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518098.430347:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522636544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430370:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518098.430387:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522637056:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430403:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518098.430452:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635520 00000100:00100000:0.0:1789518098.430479:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635520 00000100:00100000:0.0:1789518098.430535:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789518098.430544:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522635520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430613:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522635520:12345-0@lo:400:kworker.0 Request processed in 70us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.430620:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789518098.430656:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636032 00000100:00100000:0.0:1789518098.430660:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636032 00000100:00100000:0.0:1789518098.430685:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789518098.430691:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522636032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430755:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522636032:12345-0@lo:400:kworker.0 Request processed in 64us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.430761:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789518098.430780:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636544 00000100:00100000:0.0:1789518098.430784:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636544 00000100:00100000:0.0:1789518098.430821:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637056 00000100:00100000:0.0:1789518098.430824:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637056 00000100:00100000:0.0:1789518098.430843:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518098.430850:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522636544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430881:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522636544:12345-0@lo:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.430887:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518098.430898:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518098.430903:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522637056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430925:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522637056:12345-0@lo:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.430929:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789518098.430951:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518098.430954:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518098.430978:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522635520:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.430989:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522636032:0@lo:400:kworker.0 00010000:00080000:0.0:1789518098.431000:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303545c00 x1876445522636544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518098.431009:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522636544:0@lo:400:kworker.0 00010000:00080000:0.0:1789518098.431017:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f90bb80 x1876445522637056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518098.431032:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522637056:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.431081:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635648 00000100:00100000:0.0:1789518098.431085:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635648 00000100:00100000:0.0:1789518098.431113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518098.431119:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522635648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.431153:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522635648:12345-0@lo:400:kworker.0 Request processed in 35us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.431159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789518098.431580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518098.431609:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522636288:0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.431635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518098.431653:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522636800:0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.431673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518098.431694:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518098.431700:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522637184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518098.431747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518098.431776:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636288 00000100:00100000:3.0:1789518098.431780:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636288 00000100:00100000:3.0:1789518098.431807:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636800 00000100:00100000:3.0:1789518098.431811:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636800 00000100:00100000:3.0:1789518098.431831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789518098.431838:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522636288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.431873:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522636288:12345-0@lo:400:kworker.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518098.431879:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789518098.431891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789518098.431897:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522636800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.431926:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522636800:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518098.431931:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789518098.431946:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637184 00000100:00100000:3.0:1789518098.431950:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637184 00000100:00100000:3.0:1789518098.431972:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518098.431978:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522637184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518098.432000:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518098.432029:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522637184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518098.432034:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789518098.432049:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518098.432051:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789518098.432070:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811880 x1876445522637184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518098.432099:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522637184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518098.432110:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522636288:0@lo:400:kworker.0 00010000:00080000:3.0:1789518098.432118:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303544000 x1876445522636800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518098.432126:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522636800:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.432951:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635776 00000100:00100000:0.0:1789518098.432960:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635776 00000100:00100000:0.0:1789518098.433003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789518098.433010:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522635776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.433061:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522635776:12345-0@lo:400:kworker.0 Request processed in 51us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.433067:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789518098.433111:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522636160:0@lo:400:kworker.0 00000100:00100000:1.0:1789518098.433152:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518098.433177:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522636672:0@lo:400:kworker.0 00000100:00100000:1.0:1789518098.433200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518098.433233:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522635648:0@lo:400:kworker.0 00000100:00100000:1.0:1789518098.433256:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636160 00000100:00100000:1.0:1789518098.433259:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636160 00000100:00100000:1.0:1789518098.433292:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518098.433299:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522636160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518098.433335:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522636160:12345-0@lo:400:kworker.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518098.433341:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789518098.433368:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303547480 x1876445522636160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518098.433379:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522636160:0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.433787:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636672 00000100:00100000:3.0:1789518098.433793:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636672 00000100:00100000:3.0:1789518098.433831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789518098.433838:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522636672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.433876:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522636672:12345-0@lo:400:kworker.0 Request processed in 39us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518098.433882:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789518098.433900:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518098.433904:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518098.433926:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522635776:0@lo:400:kworker.0 00000100:00100000:1.0:1789518098.434074:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522636672:0@lo:400:kworker.0 00000100:00100000:2.0:1789518098.435659:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518098.435794:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522636416:0@lo:400:kworker.0 00000100:00100000:2.0:1789518098.435842:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518098.444021:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522636928:0@lo:400:kworker.0 00000100:00100000:2.0:1789518098.444094:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518098.444539:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636928 00000100:00100000:3.0:1789518098.444551:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636928 00000100:00100000:3.0:1789518098.444636:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518098.444646:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522636928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518098.444709:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522636928:12345-0@lo:400:kworker.0 Request processed in 65us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518098.444718:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789518098.444870:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789518098.444909:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303545880 x1876445522636928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518098.444925:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522636928:0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.449624:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522635904 00000100:00100000:0.0:1789518098.449642:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522635904 00000100:00100000:0.0:1789518098.449719:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522636416 00000100:00100000:0.0:1789518098.449722:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522636416 00000100:00100000:0.0:1789518098.449781:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518098.449793:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522635904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.449889:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522635904:12345-0@lo:400:kworker.0 Request processed in 99us (14236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.449897:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518098.449914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789518098.449920:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522636416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518098.449961:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522636416:12345-0@lo:400:kworker.0 Request processed in 42us (14120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.449967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1789518098.450078:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518098.450117:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522635904:0@lo:400:kworker.0 00010000:00080000:2.0:1789518098.450132:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303544a80 x1876445522636416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518098.450142:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522636416:0@lo:400:kworker.0 00010000:00010000:3.0:1789518098.485661:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518098.934021:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518098.934049:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522637312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518098.934129:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518098.935631:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637312 00000100:00100000:1.0:1789518098.935647:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637312 00000100:00100000:1.0:1789518098.935734:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518098.935746:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522637312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518098.935774:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518098.935871:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522637312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518098.935878:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789518098.935995:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881500 x1876445522637312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518098.936018:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522637312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518099.348937:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518099.348999:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518099.349115:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518099.349157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596928 00000100:00100000:0.0:1789518099.349171:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596928 00000100:00100000:0.0:1789518099.349245:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597056 00000100:00100000:0.0:1789518099.349249:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597056 00000100:00100000:0.0:1789518099.349278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:0.0:1789518099.349290:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501596928:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518099.349656:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:1.0:1789518099.349669:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501597056:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518099.349736:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501597056:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 71us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518099.349745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00080000:1.0:1789518099.349883:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518099.349888:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518099.349987:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501596800 00000100:00100000:3.0:1789518099.350006:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501596800 00000100:00100000:3.0:1789518099.350055:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 282 00000100:00100000:3.0:1789518099.350063:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501596800:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518099.350103:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501596800:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 41us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518099.350110:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 282 00000100:00100000:0.0:1789518099.350284:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501596928:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 995us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518099.350292:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:1.0:1789518099.450311:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522637568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518099.450420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518099.450526:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518099.450535:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522637440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518099.450563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518099.450609:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637568 00000100:00100000:1.0:1789518099.450619:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637568 00000100:00100000:1.0:1789518099.450680:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789518099.450690:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522637568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518099.450771:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518099.450826:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522637568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518099.450834:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789518099.450861:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637440 00000100:00100000:1.0:1789518099.450865:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637440 00000100:00100000:1.0:1789518099.450893:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518099.450900:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522637440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518099.450921:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518099.450950:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522637440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518099.450957:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789518099.451002:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f82a00 x1876445522637440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518099.451025:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522637440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518099.451038:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522637568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518099.452556:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518099.452580:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522637696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518099.452651:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518099.452715:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637696 00000100:00100000:2.0:1789518099.452734:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637696 00000100:00100000:2.0:1789518099.452787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789518099.452797:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522637696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518099.452838:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789518099.452889:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522637696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518099.452896:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789518099.452944:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522637696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789518099.511778:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789518099.959349:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:3.0:1789518099.959359:0:9506:0:(genops.c:885:class_export_put()) final put ffff8e743f88f800/5499dd84-083f-4a57-a16b-aad857025063 00000001:00100000:1.0:1789518099.959955:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:1.0:1789518099.959960:0:8421:0:(genops.c:885:class_export_put()) final put ffff8e73020d6000/5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:0.0:1789518099.960601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743f88f800/5499dd84-083f-4a57-a16b-aad857025063 for lustre-OST0001 00000020:00000080:0.0:1789518099.960672:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73020d6000/5499dd84-083f-4a57-a16b-aad857025063 for lustre-OST0000 00000020:00000080:0.0:1789518099.960694:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e743f889800 for lustre-OST0001 00000020:00000080:0.0:1789518099.960700:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73034e5000 for lustre-OST0000 00000001:02000400:2.0:1789518100.052826:0:11117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:3.0:1789518100.535038:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518101.564866:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518102.005950:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522637824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518102.006053:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518102.006212:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637824 00000100:00100000:1.0:1789518102.006223:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637824 00000100:00100000:1.0:1789518102.006316:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518102.006329:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522637824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789518102.006367:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518102.006423:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522637824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518102.006454:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789518102.006618:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789518102.006655:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f83ce00 x1876445522637824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518102.006679:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522637824:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789518102.584634:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518102.945204:0:11215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:2.0:1789518103.542237:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522637952:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542327:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542391:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522638464:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542419:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542444:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522638976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542497:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542515:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522639488:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542586:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789518103.542592:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522638080:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542633:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522638592:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542652:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542668:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522639104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542697:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542726:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522638336:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542748:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542766:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522638848:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542784:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542799:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522639360:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542817:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542834:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789518103.542840:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522638208:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542860:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542875:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522638720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542900:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522639232:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.542916:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518103.542938:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638464 00000100:00100000:2.0:1789518103.542946:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638464 00000100:00100000:2.0:1789518103.543002:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638208 00000100:00100000:2.0:1789518103.543005:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638208 00000100:00100000:2.0:1789518103.543022:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789518103.543030:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522638464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543092:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522638464:12345-0@lo:400:kworker.0 Request processed in 61us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789518103.543119:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789518103.543125:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522638208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543155:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522638208:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543161:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789518103.543179:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638976 00000100:00100000:2.0:1789518103.543183:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638976 00000100:00100000:2.0:1789518103.543200:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522639488 00000100:00100000:2.0:1789518103.543202:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522639488 00000100:00100000:2.0:1789518103.543221:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638592 00000100:00100000:2.0:1789518103.543224:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638592 00000100:00100000:2.0:1789518103.543237:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522639360 00000100:00100000:2.0:1789518103.543239:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522639360 00000100:00100000:2.0:1789518103.543250:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518103.543256:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522638976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543285:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522638976:12345-0@lo:400:kworker.0 Request processed in 29us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543290:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518103.543301:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789518103.543307:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522639488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543331:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522639488:12345-0@lo:400:kworker.0 Request processed in 25us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543337:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789518103.543347:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789518103.543360:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522638592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543388:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522638592:12345-0@lo:400:kworker.0 Request processed in 30us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543394:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789518103.543405:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518103.543411:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522639360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543433:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522639360:12345-0@lo:400:kworker.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543439:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518103.543459:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638080 00000100:00100000:2.0:1789518103.543486:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638080 00000100:00100000:2.0:1789518103.543505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522639104 00000100:00100000:2.0:1789518103.543507:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522639104 00000100:00100000:2.0:1789518103.543518:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638336 00000100:00100000:2.0:1789518103.543520:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638336 00000100:00100000:2.0:1789518103.543529:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638848 00000100:00100000:2.0:1789518103.543531:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638848 00000100:00100000:2.0:1789518103.543541:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522638720 00000100:00100000:2.0:1789518103.543543:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522638720 00000100:00100000:2.0:1789518103.543553:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522639232 00000100:00100000:2.0:1789518103.543555:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522639232 00000100:00100000:2.0:1789518103.543567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518103.543572:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522638080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543602:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522638080:12345-0@lo:400:kworker.0 Request processed in 30us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518103.543620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518103.543625:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522639104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543660:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522639104:12345-0@lo:400:kworker.0 Request processed in 34us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518103.543677:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789518103.543697:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522638336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543722:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522638336:12345-0@lo:400:kworker.0 Request processed in 25us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543728:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789518103.543738:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789518103.543744:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522638848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543765:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522638848:12345-0@lo:400:kworker.0 Request processed in 22us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543771:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789518103.543780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789518103.543785:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522638720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543805:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522638720:12345-0@lo:400:kworker.0 Request processed in 20us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789518103.543819:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789518103.543825:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522639232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543849:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522639232:12345-0@lo:400:kworker.0 Request processed in 25us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518103.543855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789518103.543904:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518103.543909:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518103.543917:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518103.543919:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518103.543949:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522638208:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543961:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522638720:0@lo:400:kworker.0 00010000:00080000:2.0:1789518103.543973:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e1880 x1876445522639232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518103.543983:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522639232:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.543992:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522638336:0@lo:400:kworker.0 00010000:00080000:2.0:1789518103.544000:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033dbb80 x1876445522638848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518103.544009:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522638848:0@lo:400:kworker.0 00010000:00080000:2.0:1789518103.544019:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e0a80 x1876445522639360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518103.544027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522639360:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.544063:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522638080:0@lo:400:kworker.0 00010000:00080000:2.0:1789518103.544075:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480d880 x1876445522638592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518103.544083:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522638592:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.544091:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522639104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518103.544100:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522638464:0@lo:400:kworker.0 00010000:00080000:2.0:1789518103.544110:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033daa00 x1876445522638976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518103.544125:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522638976:0@lo:400:kworker.0 00010000:00080000:2.0:1789518103.544139:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e0e00 x1876445522639488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518103.544146:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522639488:0@lo:400:kworker.0 00000100:00100000:1.0:1789518103.544942:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522637952 00000100:00100000:1.0:1789518103.544952:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522637952 00000100:00100000:1.0:1789518103.545007:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789518103.545015:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522637952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518103.545094:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522637952:12345-0@lo:400:kworker.0 Request processed in 79us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518103.545103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789518103.545255:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522637952:0@lo:400:kworker.0 00000100:00100000:0.0:1789518103.551782:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522639616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518103.551865:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518103.551968:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522639616 00000100:00100000:1.0:1789518103.551977:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522639616 00000100:00100000:1.0:1789518103.552036:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789518103.552045:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522639616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518103.552079:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518103.556512:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522639616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4456us (4635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518103.556696:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789518103.556901:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033daa00 x1876445522639616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518103.556928:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522639616:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789518103.608805:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518104.058005:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522639744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518104.058079:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518104.058956:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522639744 00000100:00100000:1.0:1789518104.058969:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522639744 00000100:00100000:1.0:1789518104.059031:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518104.059043:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522639744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518104.059071:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518104.059141:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522639744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518104.059148:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789518104.059282:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73036df800 x1876445522639744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518104.059303:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522639744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518104.467367:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518104.467413:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518104.467551:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518104.467601:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597184 00000100:00100000:0.0:1789518104.467612:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597184 00000100:00100000:0.0:1789518104.467687:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 284 00000100:00100000:0.0:1789518104.467699:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2389:x1876445501597184:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518104.467785:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2389:x1876445501597184:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 88us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518104.467792:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 284 00000100:00100000:2.0:1789518104.468106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597440 00000100:00100000:2.0:1789518104.468112:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597440 00000100:00100000:2.0:1789518104.468187:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597312 00000100:00100000:2.0:1789518104.468190:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597312 00000100:00100000:2.0:1789518104.468215:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 107 00000100:00100000:2.0:1789518104.468223:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501597440:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518104.468258:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501597440:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 37us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518104.468265:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 107 00000100:00100000:2.0:1789518104.468277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 108 00000100:00100000:2.0:1789518104.468284:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2389:x1876445501597312:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518104.468306:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2389:x1876445501597312:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518104.468312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 108 00000100:00080000:1.0:1789518104.468449:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518104.468454:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518104.565737:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518104.565761:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522639872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518104.565836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518104.565910:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522639872 00000100:00100000:1.0:1789518104.565919:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522639872 00000100:00100000:1.0:1789518104.565968:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518104.565978:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522639872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518104.566016:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518104.566215:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522639872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 238us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518104.566224:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518104.566275:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522639872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518104.566693:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522640000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518104.566727:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518104.567058:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640000 00000100:00100000:3.0:1789518104.567066:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640000 00000100:00100000:3.0:1789518104.567113:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518104.567122:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522640000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518104.567145:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518104.567197:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522640000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518104.567204:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789518104.567410:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f83800 x1876445522640000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518104.567431:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522640000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518104.570271:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518104.570295:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522640128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518104.570386:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518104.570434:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640128 00000100:00100000:1.0:1789518104.570444:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640128 00000100:00100000:1.0:1789518104.570506:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518104.570515:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522640128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518104.570555:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518104.571824:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522640128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1304us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518104.571848:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518104.571923:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522640128:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789518104.635719:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518105.343846:0:11312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789518105.654018:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518106.680072:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518107.119350:0:11360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 20:21:45 EDT 2026 00000100:00100000:0.0:1789518107.126006:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518107.128630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522640256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518107.128744:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518107.128952:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640256 00000100:00100000:2.0:1789518107.128964:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640256 00000100:00100000:2.0:1789518107.129101:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518107.129113:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522640256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518107.129166:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518107.129232:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522640256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518107.129241:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789518107.129290:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f09180 x1876445522640256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518107.129313:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522640256:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789518107.129709:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518107.701756:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518108.661808:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522640640:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.661890:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518108.661953:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522641152:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.661983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518108.662008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522641664:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.662028:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518108.662055:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789518108.662061:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522640512:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.662081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518108.662097:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522641024:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.662118:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518108.662142:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522641536:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.662162:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518108.662293:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522640768:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.662322:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518108.662344:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522641280:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.662367:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518108.662388:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522641792:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.662415:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518108.662436:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789518108.662442:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522640384:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.662492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518108.662514:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522640896:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.662536:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518108.662550:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522641408:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.662568:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518108.662584:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522641920:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.662604:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518108.662770:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640640 00000100:00100000:1.0:1789518108.662779:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640640 00000100:00100000:1.0:1789518108.662836:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640896 00000100:00100000:1.0:1789518108.662838:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640896 00000100:00100000:1.0:1789518108.662854:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789518108.662862:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522640640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518108.662927:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522640640:12345-0@lo:400:kworker.0 Request processed in 66us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518108.662935:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789518108.662952:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789518108.662958:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522640896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518108.662991:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522640896:12345-0@lo:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518108.662998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789518108.663037:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522640896:0@lo:400:kworker.0 00000100:00100000:1.0:1789518108.663065:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522640640:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.663174:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641152 00000100:00100000:2.0:1789518108.663179:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641152 00000100:00100000:2.0:1789518108.663648:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641664 00000100:00100000:2.0:1789518108.663653:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641664 00000100:00100000:2.0:1789518108.663669:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640512 00000100:00100000:2.0:1789518108.663681:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640512 00000100:00100000:2.0:1789518108.663699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641536 00000100:00100000:2.0:1789518108.663702:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641536 00000100:00100000:2.0:1789518108.663715:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640768 00000100:00100000:2.0:1789518108.663717:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640768 00000100:00100000:2.0:1789518108.663727:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641280 00000100:00100000:2.0:1789518108.663730:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641280 00000100:00100000:2.0:1789518108.663742:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789518108.663749:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522641152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665178:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522641152:12345-0@lo:400:kworker.0 Request processed in 1422us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665192:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789518108.665229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789518108.665240:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522641664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665300:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522641664:12345-0@lo:400:kworker.0 Request processed in 63us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665306:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789518108.665321:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518108.665328:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522640512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665362:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522640512:12345-0@lo:400:kworker.0 Request processed in 35us (3279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518108.665380:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789518108.665387:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522641536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665431:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522641536:12345-0@lo:400:kworker.0 Request processed in 44us (3268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789518108.665456:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789518108.665484:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522640768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665520:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522640768:12345-0@lo:400:kworker.0 Request processed in 58us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665526:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789518108.665539:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789518108.665546:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522641280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665574:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522641280:12345-0@lo:400:kworker.0 Request processed in 29us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665579:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789518108.665656:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641024 00000100:00100000:2.0:1789518108.665663:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641024 00000100:00100000:2.0:1789518108.665691:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641792 00000100:00100000:2.0:1789518108.665694:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641792 00000100:00100000:2.0:1789518108.665704:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641408 00000100:00100000:2.0:1789518108.665706:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641408 00000100:00100000:2.0:1789518108.665714:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522641920 00000100:00100000:2.0:1789518108.665717:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522641920 00000100:00100000:2.0:1789518108.665727:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518108.665732:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522641024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665762:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522641024:12345-0@lo:400:kworker.0 Request processed in 30us (3643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665768:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518108.665777:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518108.665783:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522641792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665809:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522641792:12345-0@lo:400:kworker.0 Request processed in 27us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665824:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518108.665836:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518108.665841:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522641408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665870:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522641408:12345-0@lo:400:kworker.0 Request processed in 29us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665876:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518108.665885:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518108.665890:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522641920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.665914:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522641920:12345-0@lo:400:kworker.0 Request processed in 23us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.665919:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518108.665947:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522640384 00000100:00100000:2.0:1789518108.665951:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522640384 00000100:00100000:2.0:1789518108.665978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789518108.665985:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522640384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.666014:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522640384:12345-0@lo:400:kworker.0 Request processed in 30us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.666019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1789518108.666168:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518108.666172:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518108.666175:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518108.666177:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518108.666200:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518108.666237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518108.666301:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522640384:0@lo:400:kworker.0 00010000:00080000:1.0:1789518108.666318:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f83ea00 x1876445522641408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518108.666330:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522641408:0@lo:400:kworker.0 00010000:00080000:1.0:1789518108.666340:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303783b80 x1876445522641920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518108.666348:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522641920:0@lo:400:kworker.0 00000100:00100000:1.0:1789518108.666359:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522640768:0@lo:400:kworker.0 00010000:00080000:1.0:1789518108.666368:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f83d180 x1876445522641280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518108.666376:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522641280:0@lo:400:kworker.0 00010000:00080000:1.0:1789518108.666385:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303782680 x1876445522641792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518108.666392:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522641792:0@lo:400:kworker.0 00000100:00100000:2.0:1789518108.666726:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642048 00000100:00100000:2.0:1789518108.666731:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642048 00000100:00100000:2.0:1789518108.666806:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518108.666814:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522642048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518108.666839:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518108.666880:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522642048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518108.666895:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518108.667337:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522641152:0@lo:400:kworker.0 00010000:00080000:3.0:1789518108.667352:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303781c00 x1876445522641664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518108.667362:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522641664:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.667381:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522640512:0@lo:400:kworker.0 00010000:00080000:3.0:1789518108.667403:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480d880 x1876445522641024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518108.667413:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522641024:0@lo:400:kworker.0 00000100:00100000:3.0:1789518108.667425:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522641536:0@lo:400:kworker.0 00010000:00080000:1.0:1789518108.668416:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303780380 x1876445522642048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518108.668440:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522642048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789518108.729499:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518109.179316:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522642176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518109.179417:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518109.179586:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642176 00000100:00100000:1.0:1789518109.179597:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642176 00000100:00100000:1.0:1789518109.179674:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518109.179684:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522642176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518109.179713:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518109.183599:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522642176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3904us (4169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518109.183615:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789518109.184386:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303546a00 x1876445522642176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518109.184415:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522642176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518109.592055:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518109.592106:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518109.592200:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518109.592244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597696 00000100:00100000:3.0:1789518109.592256:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597696 00000100:00100000:3.0:1789518109.592318:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597824 00000100:00100000:3.0:1789518109.592321:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597824 00000100:00100000:3.0:1789518109.592345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:3.0:1789518109.592355:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501597696:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518109.592433:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501597696:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 79us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518109.592441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:3.0:1789518109.592459:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:3.0:1789518109.592496:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501597824:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518109.592525:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501597824:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518109.592532:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00080000:3.0:1789518109.592557:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518109.592562:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518109.592816:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597568 00000100:00100000:0.0:1789518109.592822:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597568 00000100:00100000:0.0:1789518109.592851:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 286 00000100:00100000:0.0:1789518109.592859:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501597568:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518109.592894:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501597568:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 36us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518109.592919:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 286 00000100:00100000:0.0:1789518109.686573:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522642304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518109.687643:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522642432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518109.687714:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518109.687810:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642432 00000100:00100000:1.0:1789518109.687819:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642432 00000100:00100000:1.0:1789518109.687872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789518109.687881:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522642432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518109.687927:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518109.687978:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522642432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518109.687986:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789518109.688041:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522642432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518109.688516:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518109.688529:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522642560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518109.688563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518109.692620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518109.692733:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642304 00000100:00100000:0.0:1789518109.692742:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642304 00000100:00100000:0.0:1789518109.692794:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789518109.692806:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522642304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518109.692843:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518109.692904:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522642304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518109.692911:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789518109.692957:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303545880 x1876445522642304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518109.692978:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522642304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518109.694632:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642560 00000100:00100000:0.0:1789518109.694647:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642560 00000100:00100000:0.0:1789518109.694695:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789518109.694706:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522642560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518109.694742:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789518109.694820:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522642560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (6255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518109.694826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789518109.694880:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522642560:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789518109.749653:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518110.773685:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518111.797671:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518112.249762:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522642688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518112.249875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518112.249957:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642688 00000100:00100000:3.0:1789518112.249966:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642688 00000100:00100000:3.0:1789518112.251835:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789518112.251850:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522642688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518112.251890:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518112.251970:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522642688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518112.251977:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789518112.252030:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811880 x1876445522642688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518112.252051:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522642688:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789518112.259814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789518112.822859:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518113.781972:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522642816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518113.782601:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522643072:0@lo:400:kworker.0 00000100:00100000:3.0:1789518113.782984:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522642944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783060:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.783118:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522643584:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.783169:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522644096:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783188:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.783210:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789518113.783217:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522643200:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.783255:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522643712:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783276:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.783291:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522644224:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783307:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.783335:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643584 00000100:00100000:2.0:1789518113.783342:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643584 00000100:00100000:2.0:1789518113.783394:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789518113.783403:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522643584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783453:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522643584:12345-0@lo:400:kworker.0 Request processed in 50us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.783507:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789518113.783532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643072 00000100:00100000:2.0:1789518113.783536:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643072 00000100:00100000:2.0:1789518113.783553:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644096 00000100:00100000:2.0:1789518113.783555:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644096 00000100:00100000:2.0:1789518113.783567:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643712 00000100:00100000:2.0:1789518113.783569:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643712 00000100:00100000:2.0:1789518113.783580:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644224 00000100:00100000:2.0:1789518113.783582:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644224 00000100:00100000:2.0:1789518113.783606:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518113.783613:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522643072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783645:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522643072:12345-0@lo:400:kworker.0 Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.783652:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518113.783662:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789518113.783668:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522644096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783693:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522644096:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.783698:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789518113.783708:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789518113.783728:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522643712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783753:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522643712:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.783759:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789518113.783769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789518113.783775:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522644224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783811:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522644224:12345-0@lo:400:kworker.0 Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.783817:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789518113.783836:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643200 00000100:00100000:2.0:1789518113.783839:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643200 00000100:00100000:2.0:1789518113.783865:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789518113.783871:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522643200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783900:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522643200:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.783906:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789518113.783928:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518113.783932:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518113.783934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518113.783967:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522643200:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.783978:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522643712:0@lo:400:kworker.0 00010000:00080000:2.0:1789518113.783989:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480c700 x1876445522644224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518113.783998:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522644224:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.784008:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522643072:0@lo:400:kworker.0 00010000:00080000:2.0:1789518113.784016:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033dbb80 x1876445522643584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518113.784023:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522643584:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.784031:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522644096:0@lo:400:kworker.0 00000100:00100000:0.0:1789518113.797142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518113.797234:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522643328:0@lo:400:kworker.0 00000100:00100000:0.0:1789518113.797277:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518113.797299:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522643840:0@lo:400:kworker.0 00000100:00100000:0.0:1789518113.797320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518113.797336:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522644352:0@lo:400:kworker.0 00000100:00100000:0.0:1789518113.797359:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.797447:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644352 00000100:00100000:2.0:1789518113.797505:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644352 00000100:00100000:2.0:1789518113.797560:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518113.797571:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522644352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.797645:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522644352:12345-0@lo:400:kworker.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.797653:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518113.797678:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642816 00000100:00100000:2.0:1789518113.797682:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642816 00000100:00100000:2.0:1789518113.797725:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518113.797733:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522642816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518113.797760:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518113.797772:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643328 00000100:00100000:3.0:1789518113.797779:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643328 00000100:00100000:2.0:1789518113.797799:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522642816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.797807:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518113.797815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643840 00000100:00100000:3.0:1789518113.797819:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643840 00000100:00100000:2.0:1789518113.797843:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789518113.797852:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522643328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518113.797858:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789518113.797869:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522643840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518113.797917:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522643840:12345-0@lo:400:kworker.0 Request processed in 51us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.797925:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522643328:12345-0@lo:400:kworker.0 Request processed in 73us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518113.797927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789518113.797938:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789518113.797973:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.798010:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522642944 00000100:00100000:2.0:1789518113.798015:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522642944 00000100:00100000:3.0:1789518113.798043:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522643456:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.798046:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789518113.798058:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522642944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518113.798082:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.798106:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522642944:12345-0@lo:400:kworker.0 Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518113.798109:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522643968:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.798117:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789518113.798143:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518113.798163:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522644480:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.798165:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643968 00000100:00100000:2.0:1789518113.798176:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643968 00000100:00100000:3.0:1789518113.798180:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518113.798206:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644480 00000100:00100000:3.0:1789518113.798210:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522642944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.798211:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644480 00000100:00100000:2.0:1789518113.798237:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789518113.798244:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522643968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518113.798256:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518113.798263:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522644480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.798287:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522643968:12345-0@lo:400:kworker.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.798294:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789518113.798327:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480d880 x1876445522643968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518113.798337:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522643968:0@lo:400:kworker.0 00000100:00100000:2.0:1789518113.801199:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522644480:12345-0@lo:400:kworker.0 Request processed in 2924us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.801219:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789518113.801292:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301964a80 x1876445522644480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518113.801308:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522644480:0@lo:400:kworker.0 00000100:00100000:0.0:1789518113.801455:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522643456 00000100:00080000:2.0:1789518113.801547:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518113.801553:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518113.801561:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522643456 00000100:00100000:0.0:1789518113.801626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518113.801636:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522643456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518113.801694:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522643456:12345-0@lo:400:kworker.0 Request processed in 60us (3612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518113.801702:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789518113.801720:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522643456:0@lo:400:kworker.0 00000100:00100000:0.0:1789518113.801944:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522643328:0@lo:400:kworker.0 00010000:00080000:0.0:1789518113.801959:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033daa00 x1876445522643840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518113.801969:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522643840:0@lo:400:kworker.0 00010000:00080000:0.0:1789518113.801982:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e1880 x1876445522644352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518113.801990:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522644352:0@lo:400:kworker.0 00010000:00080000:0.0:1789518113.802001:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303782a00 x1876445522642816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518113.802031:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522642816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789518113.848010:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518114.294769:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522644608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518114.294857:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518114.295026:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644608 00000100:00100000:0.0:1789518114.295035:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644608 00000100:00100000:0.0:1789518114.295086:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518114.295095:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522644608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789518114.295117:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518114.295160:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522644608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.295167:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789518114.295731:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303544000 x1876445522644608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518114.295753:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522644608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518114.706680:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518114.707186:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501597952 00000100:00100000:2.0:1789518114.707202:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501597952 00000100:00100000:3.0:1789518114.707212:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518114.707267:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 288 00000100:00100000:3.0:1789518114.707280:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2388:x1876445501597952:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518114.707384:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2388:x1876445501597952:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 105us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518114.707403:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 288 00000100:00100000:0.0:1789518114.707661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598080 00000100:00100000:0.0:1789518114.707667:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598080 00000100:00100000:0.0:1789518114.707789:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:0.0:1789518114.707799:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501598080:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518114.707852:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501598080:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 55us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.707860:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00080000:2.0:1789518114.707926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518114.716016:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518114.717150:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598208 00000100:00100000:2.0:1789518114.717298:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598208 00000100:00080000:0.0:1789518114.717485:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518114.719310:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:2.0:1789518114.719330:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501598208:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518114.719424:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501598208:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 103us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518114.719431:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:3.0:1789518114.805707:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522644736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518114.805826:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518114.806270:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522644864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518114.806321:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518114.806370:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644864 00000100:00100000:0.0:1789518114.806378:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644864 00000100:00100000:0.0:1789518114.806424:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518114.806434:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522644864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518114.806491:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518114.806569:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522644864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.806585:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789518114.806624:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303547100 x1876445522644864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518114.806642:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522644864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518114.806705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644736 00000100:00100000:2.0:1789518114.806711:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644736 00000100:00100000:2.0:1789518114.806745:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789518114.806754:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522644736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518114.806910:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518114.807273:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518114.807283:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522644992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518114.807312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518114.807338:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522644992 00000100:00100000:1.0:1789518114.807342:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522644992 00000100:00100000:1.0:1789518114.807364:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789518114.807370:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522644992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518114.807388:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518114.807439:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522644992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518114.807445:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789518114.807491:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522644992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518114.812417:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522644736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518114.812454:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522644736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5699us (6625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518114.812489:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:2.0:1789518114.869608:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518115.893864:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518116.917789:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518117.370718:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522645120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518117.370794:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518117.370875:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522645120 00000100:00100000:2.0:1789518117.370882:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522645120 00000100:00100000:2.0:1789518117.370940:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789518117.370949:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522645120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518117.370980:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518117.371028:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522645120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518117.371035:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789518117.371056:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789518117.371097:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303780380 x1876445522645120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518117.371116:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522645120:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789518117.943077:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518118.906625:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522645632:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.906701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.906757:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522646144:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.906780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.906798:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522646656:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.906822:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.906852:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789518118.906858:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522645248:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.906885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.906904:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522645760:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.906925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.906939:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522646272:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.906956:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.906971:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522646784:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.906989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.907015:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522645504:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907036:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.907064:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522646016:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.907115:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522646528:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907135:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.907155:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789518118.907161:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522645376:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.907192:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522645888:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.907322:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522646400:0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.907411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522645632 00000100:00100000:0.0:1789518118.907419:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522645632 00000100:00100000:0.0:1789518118.907456:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646144 00000100:00100000:0.0:1789518118.907459:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646144 00000100:00100000:0.0:1789518118.907505:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646016 00000100:00100000:0.0:1789518118.907509:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646016 00000100:00100000:0.0:1789518118.907522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646528 00000100:00100000:0.0:1789518118.907525:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646528 00000100:00100000:0.0:1789518118.907552:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522645376 00000100:00100000:0.0:1789518118.907555:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522645376 00000100:00100000:0.0:1789518118.907568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646400 00000100:00100000:0.0:1789518118.907571:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646400 00000100:00100000:0.0:1789518118.907590:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789518118.907598:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522645632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907651:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522645632:12345-0@lo:400:kworker.0 Request processed in 53us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.907659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789518118.907686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789518118.907693:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522646144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907724:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522646144:12345-0@lo:400:kworker.0 Request processed in 32us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.907730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789518118.907742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789518118.907749:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522646016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907776:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522646016:12345-0@lo:400:kworker.0 Request processed in 28us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.907782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789518118.907793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789518118.907799:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522646528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907823:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522646528:12345-0@lo:400:kworker.0 Request processed in 24us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.907828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789518118.907840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789518118.907845:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522645376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907868:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522645376:12345-0@lo:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.907873:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789518118.907883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789518118.907889:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522646400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.907913:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522646400:12345-0@lo:400:kworker.0 Request processed in 24us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.907917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789518118.907943:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646656 00000100:00100000:0.0:1789518118.907947:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646656 00000100:00100000:0.0:1789518118.907965:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646272 00000100:00100000:0.0:1789518118.907967:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646272 00000100:00100000:0.0:1789518118.907979:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646784 00000100:00100000:0.0:1789518118.907982:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646784 00000100:00100000:0.0:1789518118.907992:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522645888 00000100:00100000:0.0:1789518118.907994:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522645888 00000100:00100000:0.0:1789518118.908010:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518118.908015:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522646656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.908046:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522646656:12345-0@lo:400:kworker.0 Request processed in 32us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.908052:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518118.908061:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518118.908066:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522646272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.908094:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522646272:12345-0@lo:400:kworker.0 Request processed in 26us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.908099:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518118.908108:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518118.908114:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522646784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.908141:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522646784:12345-0@lo:400:kworker.0 Request processed in 28us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.908146:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518118.908155:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789518118.908160:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522645888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518118.908184:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522645888:12345-0@lo:400:kworker.0 Request processed in 24us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.908200:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518118.908673:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522646912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518118.908713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518118.908761:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522645760 00000100:00100000:1.0:1789518118.908766:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522645760 00000100:00100000:1.0:1789518118.908799:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522645504 00000100:00100000:1.0:1789518118.908803:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522645504 00000100:00100000:1.0:1789518118.908817:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789518118.908823:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522645760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.908860:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522645760:12345-0@lo:400:kworker.0 Request processed in 35us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.908866:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789518118.908879:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789518118.908885:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522645504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.908912:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522645504:12345-0@lo:400:kworker.0 Request processed in 28us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.908917:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789518118.908936:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522646912 00000100:00100000:1.0:1789518118.908948:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522646912 00000100:00100000:1.0:1789518118.908975:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518118.908980:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522646912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518118.909002:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518118.909033:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522646912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.909038:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789518118.909071:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303600380 x1876445522646912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.909089:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522646912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518118.909161:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522645248 00000100:00100000:1.0:1789518118.909165:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522645248 00000100:00100000:1.0:1789518118.909188:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789518118.909194:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522645248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.909233:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522645248:12345-0@lo:400:kworker.0 Request processed in 39us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.909239:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789518118.909286:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522645376:0@lo:400:kworker.0 00010000:00080000:1.0:1789518118.909297:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e1880 x1876445522645888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.909305:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522645888:0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.909316:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522646400:0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.909326:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522645504:0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.909336:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522646016:0@lo:400:kworker.0 00010000:00080000:1.0:1789518118.909365:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033a8700 x1876445522646528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.909372:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522646528:0@lo:400:kworker.0 00000100:00080000:1.0:1789518118.909405:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518118.909409:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518118.909412:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518118.909414:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518118.909432:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522645248:0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.909441:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522645760:0@lo:400:kworker.0 00010000:00080000:1.0:1789518118.909453:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033a9f80 x1876445522646272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.909460:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522646272:0@lo:400:kworker.0 00010000:00080000:1.0:1789518118.909495:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033a8380 x1876445522646784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.909501:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522646784:0@lo:400:kworker.0 00000100:00100000:1.0:1789518118.909510:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522645632:0@lo:400:kworker.0 00010000:00080000:1.0:1789518118.909518:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033a9500 x1876445522646144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.909525:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522646144:0@lo:400:kworker.0 00010000:00080000:1.0:1789518118.909534:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033a9180 x1876445522646656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.909551:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522646656:0@lo:400:kworker.0 00010000:00010000:2.0:1789518118.971869:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518119.413840:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522647040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518119.413921:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518119.414351:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647040 00000100:00100000:3.0:1789518119.414360:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647040 00000100:00100000:3.0:1789518119.414418:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518119.414429:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522647040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518119.414451:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518119.414555:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522647040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518119.414563:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789518119.414820:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303603800 x1876445522647040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518119.414842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522647040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518119.830770:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518119.830820:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518119.830857:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518119.830890:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598592 00000100:00100000:0.0:1789518119.830890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598464 00000100:00100000:1.0:1789518119.830899:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598592 00000100:00100000:0.0:1789518119.830899:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598464 00000100:00100000:3.0:1789518119.830973:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598336 00000100:00100000:3.0:1789518119.830978:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598336 00000100:00100000:3.0:1789518119.831018:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 290 00000100:00100000:3.0:1789518119.831027:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501598336:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518119.831100:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501598336:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 74us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518119.831109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 290 00000100:00100000:1.0:1789518119.834837:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:1.0:1789518119.834857:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501598464:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518119.834953:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501598464:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 104us (4095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518119.834961:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:1.0:1789518119.834983:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 132 00000100:00100000:1.0:1789518119.834992:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501598592:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518119.835019:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501598592:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 28us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518119.835025:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 132 00000100:00080000:1.0:1789518119.835053:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518119.835058:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518119.929744:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522647168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518119.929826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518119.929905:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647168 00000100:00100000:2.0:1789518119.929914:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647168 00000100:00100000:2.0:1789518119.929964:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789518119.929973:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522647168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518119.930007:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518119.930055:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522647168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518119.930063:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789518119.930111:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522647168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518119.931837:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518119.931856:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522647296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518119.931913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518119.931961:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647296 00000100:00100000:2.0:1789518119.931969:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647296 00000100:00100000:2.0:1789518119.932012:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789518119.932020:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522647296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518119.932047:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518119.932086:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522647296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518119.932094:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518119.932264:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518119.932274:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522647424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518119.932309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518119.932336:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647424 00000100:00100000:1.0:1789518119.932341:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647424 00000100:00100000:1.0:1789518119.932368:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789518119.932374:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522647424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518119.932401:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518119.932446:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522647424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518119.932453:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789518119.932510:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522647424:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1789518119.934295:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303782680 x1876445522647296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518119.934321:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522647296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518119.989765:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518121.022255:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518122.040621:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518122.274747:0:11990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:22:00 (1789518120) === 00000100:00100000:2.0:1789518122.485688:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518122.485712:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522647552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518122.485782:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518122.485842:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647552 00000100:00100000:2.0:1789518122.485850:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647552 00000100:00100000:2.0:1789518122.485906:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789518122.485916:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522647552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518122.485945:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518122.485991:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522647552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518122.485998:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789518122.486036:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303782680 x1876445522647552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518122.486055:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522647552:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789518122.487959:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518122.653972:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518122.654447:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598720 00000100:00100000:2.0:1789518122.654460:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598720 00000100:00100000:2.0:1789518122.654576:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 291 00000100:00100000:2.0:1789518122.654585:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:8711:x1876445501598720:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789518122.654609:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518122.654626:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ac800/0x8d0fd67942314300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78565fee expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518122.654672:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ac800/0x8d0fd67942314300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fee expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518122.654682:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ac800/0x8d0fd67942314300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fee expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518122.654690:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac800, rc 0) 00000100:00100000:2.0:1789518122.654743:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8711:x1876445501598720:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 159us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518122.654749:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 291 00000100:00100000:3.0:1789518122.659752:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518122.659870:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598848 00000100:00100000:1.0:1789518122.659887:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598848 00000100:00100000:1.0:1789518122.659959:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 292 00000100:00100000:1.0:1789518122.659968:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8711:x1876445501598848:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789518122.660150:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8711:x1876445501598848:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 182us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518122.660158:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 292 00000100:00100000:0.0:1789518122.662421:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.664533:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501598976 00000100:00100000:3.0:1789518122.664557:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501598976 00000100:00100000:3.0:1789518122.664732:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 293 00000100:00100000:3.0:1789518122.664747:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8711:x1876445501598976:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789518122.665009:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8711:x1876445501598976:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 265us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.665018:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 293 00000100:00100000:3.0:1789518122.669697:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518122.669932:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501599104 00000100:00100000:2.0:1789518122.669946:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501599104 00000100:00100000:2.0:1789518122.670370:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 294 00000100:00100000:2.0:1789518122.670386:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8715:x1876445501599104:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518122.670683:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8715:x1876445501599104:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 299us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518122.670694:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 294 00000100:00100000:0.0:1789518122.691787:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.691925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501599232 00000100:00100000:3.0:1789518122.691943:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501599232 00000100:00100000:3.0:1789518122.692039:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 295 00000100:00100000:3.0:1789518122.692059:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8715:x1876445501599232:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518122.692319:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8715:x1876445501599232:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 269us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.692329:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 295 00000100:00100000:0.0:1789518122.702078:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518122.703641:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501599360 00000100:00100000:2.0:1789518122.703665:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501599360 00000100:00100000:2.0:1789518122.703757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 296 00000100:00100000:2.0:1789518122.703770:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8715:x1876445501599360:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518122.704041:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8715:x1876445501599360:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 272us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518122.704049:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 296 00000100:00100000:0.0:1789518122.717448:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.718588:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501599488 00000100:00100000:3.0:1789518122.718606:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501599488 00000100:00100000:3.0:1789518122.718692:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 297 00000100:00100000:3.0:1789518122.718731:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+11:8711:x1876445501599488:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518122.718766:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518122.718795:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030400/0x8d0fd67942314307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856601f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518122.718838:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030400/0x8d0fd67942314307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856601f expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518122.718854:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030400/0x8d0fd67942314307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856601f expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518122.718865:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030400, rc 0) 00000100:00100000:3.0:1789518122.721967:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:8711:x1876445501599488:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 3219us (4509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.721996:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 297 00000100:00100000:3.0:1789518122.724946:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518122.725132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501599616 00000100:00100000:1.0:1789518122.725146:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501599616 00000100:00100000:1.0:1789518122.725266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 298 00000100:00100000:1.0:1789518122.725279:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:8711:x1876445501599616:12345-192.168.202.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789518122.725314:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789518122.725340:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789518122.725345:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789518122.725349:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789518122.725353:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789518122.725361:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789518122.728964:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:8711:x1876445501599616:12345-192.168.202.43@tcp:256:mount.lustre.0 Request processed in 3671us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518122.728995:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 298 00000100:00100000:0.0:1789518122.733200:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.733602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501599744 00000100:00100000:3.0:1789518122.733617:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501599744 00000100:00100000:3.0:1789518122.733696:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 299 00000100:00100000:3.0:1789518122.733710:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:8711:x1876445501599744:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518122.733735:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518122.733759:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566026 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518122.733800:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518122.733814:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518122.733845:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031e00, rc 0) 00000100:00100000:3.0:1789518122.733925:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8711:x1876445501599744:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 219us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.733933:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 299 00000100:00100000:3.0:1789518122.738150:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518122.739046:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501599872 00000100:00100000:1.0:1789518122.739065:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501599872 00000100:00100000:1.0:1789518122.739355:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 300 00000100:00100000:1.0:1789518122.739370:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8711:x1876445501599872:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789518122.739918:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8711:x1876445501599872:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 548us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518122.739928:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 300 00000100:00100000:2.0:1789518122.742634:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.742814:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600000 00000100:00100000:3.0:1789518122.742828:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600000 00000100:00100000:3.0:1789518122.742931:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 301 00000100:00100000:3.0:1789518122.742944:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8711:x1876445501600000:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789518122.743177:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8711:x1876445501600000:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 227us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.743187:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 301 00000100:00100000:1.0:1789518122.748009:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.748231:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600128 00000100:00100000:3.0:1789518122.748245:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600128 00000100:00100000:3.0:1789518122.748319:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 302 00000100:00100000:3.0:1789518122.748331:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8718:x1876445501600128:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518122.748942:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8718:x1876445501600128:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 610us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.748953:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 302 00000100:00100000:0.0:1789518122.754792:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.755314:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600256 00000100:00100000:3.0:1789518122.755331:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600256 00000100:00100000:2.0:1789518122.755757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 303 00000100:00100000:2.0:1789518122.755774:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8718:x1876445501600256:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518122.756340:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:8718:x1876445501600256:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 568us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518122.756350:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 303 00000100:00100000:2.0:1789518122.762159:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518122.762347:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518122.762547:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518122.762714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600384 00000100:00100000:1.0:1789518122.762728:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600384 00000100:00100000:1.0:1789518122.762781:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601024 00000100:00100000:1.0:1789518122.762785:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601024 00000100:00100000:1.0:1789518122.762838:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:1.0:1789518122.762851:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501601024:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518122.762954:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501601024:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 106us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518122.762962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:0.0:1789518122.763141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789518122.763149:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1876445501600384:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518122.763193:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b5627b1d-cf97-43a8-8382-f16e6ba3aeed@192.168.202.43@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1789518122.763243:0:6514:0:(genops.c:1384:class_connect()) connect: client b5627b1d-cf97-43a8-8382-f16e6ba3aeed, cookie 0x8d0fd67942314315 00000004:00100000:0.0:1789518122.763278:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518122.763484:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8e743f8a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518122.763534:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2386:x1876445501600384:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 384us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518122.763541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00080000:0.0:1789518122.763709:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518122.765607:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601152 00000100:00100000:0.0:1789518122.765628:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601152 00000100:00100000:2.0:1789518122.765759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00080000:2.0:1789518122.766178:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518122.766338:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600640 00000100:00100000:3.0:1789518122.766346:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600640 00000100:00100000:1.0:1789518122.766951:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:1.0:1789518122.766969:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501601152:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518122.767298:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501601152:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 335us (4749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518122.767308:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:0.0:1789518122.767474:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:0.0:1789518122.767482:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1876445501600640:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518122.767528:0:8781:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from b5627b1d-cf97-43a8-8382-f16e6ba3aeed@192.168.202.43@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1789518122.767582:0:8781:0:(genops.c:1384:class_connect()) connect: client b5627b1d-cf97-43a8-8382-f16e6ba3aeed, cookie 0x8d0fd6794231431c 00000004:00100000:0.0:1789518122.767614:0:8781:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518122.767912:0:8781:0:(import.c:65:import_set_state_nolock()) ffff8e743f8a8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518122.767951:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2386:x1876445501600640:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 470us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518122.767960:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:2.0:1789518122.768965:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518122.769781:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600512 00000100:00100000:0.0:1789518122.769797:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600512 00000100:00100000:0.0:1789518122.769873:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789518122.769882:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:0:x1876445501600512:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518122.769928:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518122.770040:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:0:x1876445501600512:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 158us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518122.770048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:2.0:1789518122.770390:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518122.770656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600896 00000100:00100000:0.0:1789518122.770663:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600896 00000100:00100000:0.0:1789518122.770703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:0.0:1789518122.770711:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501600896:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518122.770729:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518122.770761:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501600896:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 51us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518122.770768:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00080000:3.0:1789518122.771066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518122.774202:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518122.774348:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601280 00000100:00100000:0.0:1789518122.774365:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601280 00000100:00100000:0.0:1789518122.774528:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789518122.774539:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501601280:12345-192.168.202.43@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789518122.774656:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501601280:12345-192.168.202.43@tcp:40:mount.lustre.0 Request processed in 107us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518122.774664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789518122.776054:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518122.776203:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501600768 00000100:00100000:0.0:1789518122.776213:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501600768 00000100:00080000:3.0:1789518122.776346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789518122.776599:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:0.0:1789518122.776613:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:0:x1876445501600768:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518122.776669:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789518122.776769:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:0:x1876445501600768:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 160us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518122.776776:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789518122.778195:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518122.778235:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518122.778307:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.778380:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601408 00000100:00100000:3.0:1789518122.778399:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601408 00000100:00100000:3.0:1789518122.778450:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601536 00000100:00100000:3.0:1789518122.778453:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601536 00000100:00100000:3.0:1789518122.778512:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:3.0:1789518122.778521:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876445501601408:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518122.778562:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b5627b1d-cf97-43a8-8382-f16e6ba3aeed@192.168.202.43@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1789518122.778607:0:8429:0:(genops.c:1384:class_connect()) connect: client b5627b1d-cf97-43a8-8382-f16e6ba3aeed, cookie 0x8d0fd67942314323 00002000:00100000:3.0:1789518122.778622:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b5627b1d-cf97-43a8-8382-f16e6ba3aeed/ffff8e7437795800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518122.778637:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518122.778731:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789518122.778765:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e7437794000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518122.778825:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2386:x1876445501601408:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 305us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.778831:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:3.0:1789518122.778845:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:3.0:1789518122.778848:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876445501601536:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518122.778860:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b5627b1d-cf97-43a8-8382-f16e6ba3aeed@192.168.202.43@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1789518122.778873:0:8429:0:(genops.c:1384:class_connect()) connect: client b5627b1d-cf97-43a8-8382-f16e6ba3aeed, cookie 0x8d0fd6794231432a 00002000:00100000:3.0:1789518122.778876:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b5627b1d-cf97-43a8-8382-f16e6ba3aeed/ffff8e7437792800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518122.778888:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518122.778916:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518122.778925:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e7437797800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518122.778941:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2386:x1876445501601536:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 92us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518122.778963:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:1.0:1789518122.780610:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601664 00000100:00100000:1.0:1789518122.780628:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601664 00000100:00100000:1.0:1789518122.780758:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:1.0:1789518122.780770:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501601664:12345-192.168.202.43@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789518122.780991:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501601664:12345-192.168.202.43@tcp:900:mount.lustre.0 Request processed in 223us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518122.781000:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:2.0:1789518122.793621:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518122.793829:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601792 00000100:00100000:3.0:1789518122.793843:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601792 00000100:00100000:3.0:1789518122.793942:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:3.0:1789518122.793954:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501601792:12345-192.168.202.43@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789518122.794623:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789518122.794983:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:8711:x1876445501601792:12345-192.168.202.43@tcp:33:mount.lustre.0 Request processed in 1020us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518122.794993:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00010000:00010000:1.0:1789518123.062049:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518124.021709:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789518124.021728:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522647680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518124.021799:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518124.021839:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647680 00000100:00100000:0.0:1789518124.021847:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647680 00000100:00100000:1.0:1789518124.021849:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522647808:0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.021878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518124.021902:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518124.021910:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647808 00000100:00100000:0.0:1789518124.021912:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522647680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518124.021914:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647808 00002000:00000024:0.0:1789518124.021935:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518124.021940:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789518124.021946:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522647808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.021992:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522647808:12345-0@lo:400:kworker.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518124.022000:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789518124.022053:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522647808:0@lo:400:kworker.0 00000100:00080000:3.0:1789518124.022126:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518124.022206:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522647936:0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.022238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518124.022351:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522647936 00000100:00100000:3.0:1789518124.022356:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522647936 00000100:00100000:3.0:1789518124.022390:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789518124.022397:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522647936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022579:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522648064:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022609:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518124.022629:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522648576:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518124.022663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522649088:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518124.022720:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789518124.022726:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522648192:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518124.022754:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522648704:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022772:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518124.022782:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522649216:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022803:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518124.022839:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648576 00000100:00100000:2.0:1789518124.022844:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648576 00000100:00100000:2.0:1789518124.022880:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649088 00000100:00100000:2.0:1789518124.022883:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649088 00000100:00100000:2.0:1789518124.022898:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648192 00000100:00100000:2.0:1789518124.022900:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648192 00000100:00100000:2.0:1789518124.022910:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648704 00000100:00100000:2.0:1789518124.022912:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648704 00000100:00100000:2.0:1789518124.022925:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789518124.022931:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522648576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.022970:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522648576:12345-0@lo:400:kworker.0 Request processed in 38us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518124.022977:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789518124.023006:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789518124.023013:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522649088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.023046:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522649088:12345-0@lo:400:kworker.0 Request processed in 33us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518124.023052:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789518124.023062:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789518124.023075:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522648192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.023103:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522648192:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518124.023108:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789518124.023120:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789518124.023125:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522648704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518124.023207:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522647936:12345-0@lo:400:kworker.0 Request processed in 810us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518124.023213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789518124.023552:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522647936:0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.023574:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522648448:0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.023611:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518124.023689:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522648960:0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.023712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518124.023732:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789518124.023738:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522648320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518124.023781:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649216 00000100:00100000:3.0:1789518124.023786:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649216 00000100:00100000:3.0:1789518124.023823:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648448 00000100:00100000:3.0:1789518124.023826:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648448 00000100:00100000:3.0:1789518124.023847:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518124.023854:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522649216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518124.023889:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522649216:12345-0@lo:400:kworker.0 Request processed in 36us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518124.023895:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518124.023907:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789518124.023913:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522648448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518124.023938:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522648448:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518124.023949:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518124.023997:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518124.024016:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522648832:0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.024036:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518124.024036:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522647680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2126us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518124.024045:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1789518124.024060:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f71c00 x1876445522648448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518124.024071:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522648448:0@lo:400:kworker.0 00010000:00080000:1.0:1789518124.024083:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303603800 x1876445522647680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518124.024098:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522647680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518124.024122:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648960 00000100:00100000:1.0:1789518124.024125:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648960 00000100:00100000:1.0:1789518124.024146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789518124.024153:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522648960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.024199:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522648960:12345-0@lo:400:kworker.0 Request processed in 46us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518124.024205:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789518124.024222:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648832 00000100:00100000:1.0:1789518124.024224:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648832 00000100:00100000:1.0:1789518124.024237:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518124.024240:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522648832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.024264:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522648832:12345-0@lo:400:kworker.0 Request processed in 24us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518124.024268:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789518124.024333:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f70a80 x1876445522648832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518124.024340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522648832:0@lo:400:kworker.0 00000100:00100000:0.0:1789518124.024346:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522648960:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.024409:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522648704:12345-0@lo:400:kworker.0 Request processed in 1283us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518124.024413:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789518124.024429:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648064 00000100:00100000:2.0:1789518124.024433:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648064 00000100:00100000:2.0:1789518124.024586:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522648320 00000100:00100000:2.0:1789518124.024590:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522648320 00000100:00100000:0.0:1789518124.024648:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518124.024653:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522648064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518124.024678:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522648064:12345-0@lo:400:kworker.0 Request processed in 26us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518124.024682:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518124.024690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789518124.024693:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522648320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518124.024717:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522648320:12345-0@lo:400:kworker.0 Request processed in 24us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518124.024721:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1789518124.024759:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518124.024763:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518124.024764:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518124.024766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518124.024782:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522648192:0@lo:400:kworker.0 00010000:00080000:2.0:1789518124.024789:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f73b80 x1876445522648704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518124.024795:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522648704:0@lo:400:kworker.0 00010000:00080000:2.0:1789518124.024801:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f70e00 x1876445522649216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518124.024806:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522649216:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.024812:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522648064:0@lo:400:kworker.0 00000100:00100000:2.0:1789518124.024828:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522648576:0@lo:400:kworker.0 00010000:00080000:2.0:1789518124.024835:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f71f80 x1876445522649088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518124.024840:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522649088:0@lo:400:kworker.0 00000100:00100000:1.0:1789518124.024910:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522648320:0@lo:400:kworker.0 00010000:00010000:1.0:1789518124.085853:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518124.533659:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522649344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518124.533747:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518124.534114:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649344 00000100:00100000:2.0:1789518124.534124:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649344 00000100:00100000:2.0:1789518124.534204:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789518124.534216:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522649344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518124.534250:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518124.534584:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522649344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 369us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518124.534592:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1789518124.534677:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303602a00 x1876445522649344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518124.534699:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522649344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518125.045738:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518125.045761:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522649472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518125.045827:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518125.046110:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522649600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518125.046147:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518125.046208:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649472 00000100:00100000:3.0:1789518125.046216:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649472 00000100:00100000:3.0:1789518125.046263:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518125.046272:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522649472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518125.046303:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518125.046352:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522649472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518125.046359:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789518125.046404:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f71f80 x1876445522649472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518125.046422:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522649472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518125.046505:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649600 00000100:00100000:0.0:1789518125.046510:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649600 00000100:00100000:0.0:1789518125.046543:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789518125.046550:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7431686450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522649600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518125.046573:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789518125.049880:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7431686450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522649600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3320us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518125.049898:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789518125.050271:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522649728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518125.050367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518125.050596:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649728 00000100:00100000:1.0:1789518125.050604:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649728 00000100:00100000:1.0:1789518125.050654:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789518125.050663:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522649728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518125.050699:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518125.050754:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522649728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518125.050760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789518125.050815:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522649728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518125.050932:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522649600:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789518125.109922:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518126.133639:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518127.158872:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518127.605850:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518127.605887:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522649856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518127.607667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518127.614201:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649856 00000100:00100000:3.0:1789518127.614222:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649856 00000100:00080000:3.0:1789518127.614399:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518127.614432:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518127.614452:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789518127.614496:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522649856:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518127.614516:0:8431:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1789518127.615933:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518127.616125:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522649856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1676us (8461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518127.616139:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789518127.616761:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f72300 x1876445522649856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518127.616785:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522649856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518128.020696:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518128.020743:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518128.020774:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518128.020806:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518128.020840:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518128.020863:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518128.020898:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602048 00000100:00100000:2.0:1789518128.020909:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518128.020912:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602048 00000100:00100000:2.0:1789518128.020946:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602304 00000100:00100000:2.0:1789518128.020950:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602304 00000100:00100000:2.0:1789518128.020980:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602176 00000100:00100000:1.0:1789518128.020980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602432 00000100:00100000:2.0:1789518128.020982:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602176 00000100:00100000:1.0:1789518128.020982:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602432 00000100:00100000:1.0:1789518128.021000:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:1.0:1789518128.021011:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501602048:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518128.021113:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501602048:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 103us (432us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518128.027331:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518128.027929:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518128.028179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:2.0:1789518128.028209:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602304:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518128.028344:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602304:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 151us (7600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518128.028354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:2.0:1789518128.028426:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 143 00000100:00100000:2.0:1789518128.028435:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501602176:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518128.028497:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501602176:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 63us (7666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518128.028504:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 143 00000100:00100000:2.0:1789518128.028518:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 144 00000100:00100000:2.0:1789518128.028527:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602432:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518128.028556:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602432:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 30us (7692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518128.028562:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 144 00000100:00100000:2.0:1789518128.028602:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602560 00000100:00100000:2.0:1789518128.028612:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602560 00000100:00100000:2.0:1789518128.028678:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602688 00000100:00100000:2.0:1789518128.028682:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602688 00000100:00100000:2.0:1789518128.028707:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:2.0:1789518128.028714:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602560:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518128.028747:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602560:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 34us (7972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518128.028754:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:2.0:1789518128.028767:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:2.0:1789518128.028774:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602688:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518128.028806:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2387:x1876445501602688:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 33us (7897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518128.028813:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00080000:0.0:1789518128.028941:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518128.028946:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518128.029084:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501601920 00000100:00100000:2.0:1789518128.029089:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501601920 00000100:00100000:2.0:1789518128.029135:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 305 00000100:00100000:2.0:1789518128.029143:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501601920:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518128.029174:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501601920:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32us (8367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518128.029180:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 305 00000100:00100000:1.0:1789518128.029807:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 141 00000001:00100000:0.0:1789518128.124874:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:00100000:0.0:1789518128.124911:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:00100000:2.0:1789518128.130548:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:00100000:0.0:1789518128.131932:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:02000400:3.0:1789518128.146747:0:12183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789518128.182969:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518129.141846:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518129.141869:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522649984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518129.141938:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518129.142623:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522649984 00000100:00100000:3.0:1789518129.142632:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522649984 00000100:00100000:0.0:1789518129.142855:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522650368:0@lo:400:kworker.0 00000100:00100000:3.0:1789518129.142907:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518129.142916:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522649984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518129.142932:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789518129.142946:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518129.142952:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522650880:0@lo:400:kworker.0 00000100:00100000:0.0:1789518129.142975:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518129.142982:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522649984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518129.142989:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789518129.142996:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522651392:0@lo:400:kworker.0 00000100:00100000:0.0:1789518129.143014:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789518129.143050:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303602d80 x1876445522649984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518129.143058:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518129.143069:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522649984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518129.143070:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522650240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518129.143087:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789518129.143092:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522650496:0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.143116:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518129.143120:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522650368 00000100:00100000:0.0:1789518129.143123:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522650368 00000100:00100000:1.0:1789518129.143145:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522650752:0@lo:400:kworker.0 00000100:00100000:0.0:1789518129.143149:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518129.143155:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522650368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.143178:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518129.143186:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522650368:12345-0@lo:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518129.143192:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789518129.143199:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522651264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.143217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518129.143232:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789518129.143237:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522650112:0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.143438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522650880 00000100:00100000:2.0:1789518129.143453:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522650880 00000100:00100000:2.0:1789518129.143627:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651392 00000100:00100000:2.0:1789518129.143631:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651392 00000100:00100000:2.0:1789518129.143655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522650240 00000100:00100000:2.0:1789518129.143658:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522650240 00000100:00100000:2.0:1789518129.143668:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651264 00000100:00100000:2.0:1789518129.143671:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651264 00000100:00100000:2.0:1789518129.143685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789518129.143691:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522650880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.143728:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522650880:12345-0@lo:400:kworker.0 Request processed in 37us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518129.143734:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789518129.143747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518129.143753:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522651392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.143780:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522651392:12345-0@lo:400:kworker.0 Request processed in 26us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518129.143785:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518129.143794:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789518129.143799:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522650240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518129.143822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518129.143823:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522650240:12345-0@lo:400:kworker.0 Request processed in 24us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518129.143828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789518129.143831:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522651264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518129.143860:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522651264:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518129.143866:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1789518129.143903:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518129.143907:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518129.143956:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518129.143988:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522650624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.144013:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518129.144047:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522651136:0@lo:400:kworker.0 00000100:00100000:0.0:1789518129.144058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522650624 00000100:00100000:0.0:1789518129.144062:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522650624 00000100:00100000:1.0:1789518129.144069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518129.144086:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789518129.144099:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522650624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.144119:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522650240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518129.144128:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522650624:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518129.144131:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522651264:0@lo:400:kworker.0 00000100:00100000:0.0:1789518129.144134:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789518129.144146:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522650624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.144168:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522650752 00000100:00100000:1.0:1789518129.144171:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522650752 00000100:00100000:2.0:1789518129.144189:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651136 00000100:00100000:2.0:1789518129.144193:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651136 00000100:00100000:1.0:1789518129.144211:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789518129.144215:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518129.144217:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522650752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.144220:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522651136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.144252:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522651136:12345-0@lo:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518129.144258:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789518129.144307:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518129.144459:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522650752:12345-0@lo:400:kworker.0 Request processed in 242us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518129.144485:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789518129.144518:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518129.144546:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522651008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.144569:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518129.144586:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522651520:0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.144606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518129.144631:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522650368:0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.144633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522650496 00000100:00100000:2.0:1789518129.144642:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522650496 00000100:00100000:1.0:1789518129.144642:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522650880:0@lo:400:kworker.0 00010000:00080000:1.0:1789518129.144655:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303600e00 x1876445522651392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518129.144663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651008 00000100:00100000:1.0:1789518129.144664:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522651392:0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.144665:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651008 00000100:00100000:3.0:1789518129.144768:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522650112 00000100:00100000:3.0:1789518129.144773:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522650112 00000100:00100000:3.0:1789518129.144803:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789518129.144810:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522650112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518129.144842:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522650112:12345-0@lo:400:kworker.0 Request processed in 33us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518129.144847:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789518129.149141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789518129.149168:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522650496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.149264:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522650496:12345-0@lo:400:kworker.0 Request processed in 109us (4744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518129.149272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789518129.149293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789518129.149301:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522651008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518129.149332:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522651008:12345-0@lo:400:kworker.0 Request processed in 33us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518129.149337:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789518129.149682:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522650112:0@lo:400:kworker.0 00010000:00080000:0.0:1789518129.149700:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303601500 x1876445522651136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518129.149711:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522651136:0@lo:400:kworker.0 00010000:00080000:0.0:1789518129.149721:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303602680 x1876445522650752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518129.149728:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522650752:0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.149926:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651520 00000100:00100000:1.0:1789518129.149947:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651520 00000100:00100000:1.0:1789518129.150001:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789518129.150009:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522651520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518129.150047:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522651520:12345-0@lo:400:kworker.0 Request processed in 40us (5440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518129.150053:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789518129.150642:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518129.150648:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518129.150746:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522650496:0@lo:400:kworker.0 00010000:00080000:3.0:1789518129.150759:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303600a80 x1876445522651008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518129.150768:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522651008:0@lo:400:kworker.0 00010000:00080000:3.0:1789518129.150777:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303600700 x1876445522651520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518129.150785:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522651520:0@lo:400:kworker.0 00010000:00010000:0.0:1789518129.205730:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518129.654779:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518129.654805:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522651648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518129.654881:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518129.655069:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651648 00000100:00100000:2.0:1789518129.655079:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651648 00000100:00100000:2.0:1789518129.655133:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789518129.655144:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522651648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518129.655167:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518129.655217:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522651648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518129.655224:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789518129.655336:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303602680 x1876445522651648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518129.655354:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522651648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518130.166358:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518130.166423:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522651776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518130.166528:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518130.166531:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518130.166538:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522651904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518130.166569:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518130.166597:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651776 00000100:00100000:0.0:1789518130.166604:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651776 00000100:00100000:0.0:1789518130.166663:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789518130.166673:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74360fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522651776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518130.166703:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518130.166761:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74360fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522651776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518130.166768:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789518130.166961:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522651904 00000100:00100000:0.0:1789518130.166974:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522651904 00000100:00100000:0.0:1789518130.167004:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789518130.167010:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522651904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518130.167033:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518130.167069:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522651904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518130.167076:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789518130.167111:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522651904:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789518130.167115:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f70000 x1876445522651776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518130.167129:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522651776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518130.167960:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518130.167974:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522652032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518130.168019:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518130.168322:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652032 00000100:00100000:2.0:1789518130.168327:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652032 00000100:00100000:2.0:1789518130.168361:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789518130.168379:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522652032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518130.168415:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518130.168535:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522652032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518130.168542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789518130.168622:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522652032:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789518130.231644:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518131.263804:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518132.281008:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518132.726977:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518132.727000:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522652160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518132.727067:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518132.727128:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652160 00000100:00100000:2.0:1789518132.727149:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652160 00000100:00100000:2.0:1789518132.727201:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518132.727210:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522652160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518132.727239:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518132.727279:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522652160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518132.727286:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789518132.727304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789518132.727333:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f71500 x1876445522652160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518132.727350:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522652160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518133.146124:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518133.146171:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518133.146195:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518133.146217:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518133.146235:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518133.146255:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518133.146282:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518133.146308:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603072 00000100:00100000:1.0:1789518133.146332:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603072 00000100:00100000:1.0:1789518133.146385:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603328 00000100:00100000:1.0:1789518133.146387:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603328 00000100:00100000:1.0:1789518133.146399:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602944 00000100:00100000:1.0:1789518133.146401:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602944 00000100:00100000:1.0:1789518133.152532:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603200 00000100:00100000:1.0:1789518133.152542:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603200 00000100:00100000:1.0:1789518133.152574:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 151 00000100:00100000:1.0:1789518133.152585:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501603072:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518133.152672:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501603072:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 90us (6501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518133.152679:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 151 00000100:00100000:1.0:1789518133.152696:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00100000:1.0:1789518133.152702:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603328:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518133.152726:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603328:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (6530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518133.152732:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00100000:1.0:1789518133.152744:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 153 00000100:00100000:1.0:1789518133.152750:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501602944:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518133.152772:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501602944:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (6536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518133.152778:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 153 00000100:00100000:1.0:1789518133.152789:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 154 00000100:00100000:1.0:1789518133.152796:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603200:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518133.152815:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603200:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (6560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518133.152827:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 154 00000100:00100000:1.0:1789518133.152855:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603584 00000100:00100000:1.0:1789518133.152858:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603584 00000100:00100000:1.0:1789518133.152889:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603456 00000100:00100000:1.0:1789518133.152892:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603456 00000100:00100000:1.0:1789518133.152914:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789518133.152921:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603584:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518133.152946:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603584:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (6728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518133.152952:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789518133.152963:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:1.0:1789518133.152968:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603456:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518133.152990:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501603456:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (6707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518133.152996:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00080000:1.0:1789518133.153023:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518133.153028:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518133.153030:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518133.153033:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518133.156559:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501602816 00000100:00100000:3.0:1789518133.156573:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501602816 00000100:00100000:3.0:1789518133.156644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 307 00000100:00100000:3.0:1789518133.156653:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501602816:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518133.156735:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501602816:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 83us (10621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518133.156743:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 307 00010000:00010000:1.0:1789518133.302534:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518134.261943:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522652672:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262010:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262062:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522653184:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262100:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522653696:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262121:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262158:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789518134.262164:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522652288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262192:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262228:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522652800:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262268:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262285:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522653312:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262320:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522653824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262337:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262361:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522652544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262429:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522653056:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262448:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262489:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522653568:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262529:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789518134.262534:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522652416:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262563:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522652928:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262597:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522653440:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262615:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518134.262637:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652672 00000100:00100000:0.0:1789518134.262645:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652672 00000100:00100000:0.0:1789518134.262703:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653184 00000100:00100000:0.0:1789518134.262706:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653184 00000100:00100000:0.0:1789518134.262730:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653056 00000100:00100000:0.0:1789518134.262733:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653056 00000100:00100000:0.0:1789518134.262744:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653568 00000100:00100000:0.0:1789518134.262747:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653568 00000100:00100000:0.0:1789518134.262757:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652416 00000100:00100000:0.0:1789518134.262760:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652416 00000100:00100000:0.0:1789518134.262770:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653440 00000100:00100000:0.0:1789518134.262772:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653440 00000100:00100000:0.0:1789518134.262785:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789518134.262793:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522652672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262847:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522652672:12345-0@lo:400:kworker.0 Request processed in 54us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.262864:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789518134.262883:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518134.262889:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522653184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262918:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522653184:12345-0@lo:400:kworker.0 Request processed in 29us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.262924:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518134.262934:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789518134.262940:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522653056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.262967:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522653056:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.262973:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789518134.262984:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518134.262990:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522653568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263016:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522653568:12345-0@lo:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263022:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518134.263031:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789518134.263037:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522652416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263061:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522652416:12345-0@lo:400:kworker.0 Request processed in 24us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263066:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789518134.263077:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789518134.263083:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522653440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263107:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522653440:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263119:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789518134.263142:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653696 00000100:00100000:0.0:1789518134.263146:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653696 00000100:00100000:0.0:1789518134.263165:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653312 00000100:00100000:0.0:1789518134.263168:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653312 00000100:00100000:0.0:1789518134.263179:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653824 00000100:00100000:0.0:1789518134.263181:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653824 00000100:00100000:0.0:1789518134.263189:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652928 00000100:00100000:0.0:1789518134.263192:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652928 00000100:00100000:0.0:1789518134.263202:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789518134.263208:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522653696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263240:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522653696:12345-0@lo:400:kworker.0 Request processed in 32us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263246:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789518134.263255:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518134.263260:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522653312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263284:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522653312:12345-0@lo:400:kworker.0 Request processed in 24us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263290:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518134.263299:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518134.263304:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522653824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263329:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522653824:12345-0@lo:400:kworker.0 Request processed in 25us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263334:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518134.263345:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518134.263350:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522652928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263385:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522652928:12345-0@lo:400:kworker.0 Request processed in 35us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263391:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518134.263421:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652288 00000100:00100000:0.0:1789518134.263425:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652288 00000100:00100000:0.0:1789518134.263448:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789518134.263454:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522652288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263505:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522652288:12345-0@lo:400:kworker.0 Request processed in 51us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263511:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789518134.263537:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652800 00000100:00100000:0.0:1789518134.263541:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652800 00000100:00100000:0.0:1789518134.263566:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522652544 00000100:00100000:0.0:1789518134.263569:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522652544 00000100:00100000:0.0:1789518134.263582:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518134.263587:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522652800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263620:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522652800:12345-0@lo:400:kworker.0 Request processed in 33us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263626:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518134.263637:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518134.263643:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522652544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263670:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522652544:12345-0@lo:400:kworker.0 Request processed in 27us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518134.263676:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1789518134.263714:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518134.263719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518134.263721:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518134.263730:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789518134.263766:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522652416:0@lo:400:kworker.0 00010000:00080000:0.0:1789518134.263780:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303600a80 x1876445522652928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518134.263790:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522652928:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263800:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522653440:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522652544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263817:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522653056:0@lo:400:kworker.0 00010000:00080000:0.0:1789518134.263827:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303601c00 x1876445522653568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518134.263836:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522653568:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263876:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522652288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263884:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522652800:0@lo:400:kworker.0 00010000:00080000:0.0:1789518134.263895:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303603b80 x1876445522653312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518134.263903:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522653312:0@lo:400:kworker.0 00010000:00080000:0.0:1789518134.263913:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303602300 x1876445522653824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518134.263920:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522653824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518134.263930:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522652672:0@lo:400:kworker.0 00010000:00080000:0.0:1789518134.263939:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303600e00 x1876445522653184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518134.263953:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522653184:0@lo:400:kworker.0 00010000:00080000:0.0:1789518134.263965:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303601f80 x1876445522653696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518134.263972:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522653696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518134.265726:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522653952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518134.265792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518134.265854:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522653952 00000100:00100000:3.0:1789518134.265861:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522653952 00000100:00100000:3.0:1789518134.265904:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518134.265914:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522653952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518134.265942:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518134.265984:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522653952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518134.265991:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1789518134.266027:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e92d80 x1876445522653952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518134.266046:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522653952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789518134.325765:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518134.773835:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522654080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518134.773916:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518134.774037:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654080 00000100:00100000:2.0:1789518134.774046:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654080 00000100:00100000:2.0:1789518134.774109:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789518134.774119:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522654080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518134.774140:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518134.779912:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522654080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5781us (5981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518134.779949:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789518134.780584:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303546a00 x1876445522654080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518134.780616:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522654080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518135.285852:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522654336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518135.285960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518135.286037:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518135.286044:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522654208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518135.286068:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518135.286080:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654336 00000100:00100000:0.0:1789518135.286092:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654336 00000100:00100000:0.0:1789518135.286150:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654208 00000100:00100000:0.0:1789518135.286153:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654208 00000100:00100000:0.0:1789518135.286170:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518135.286179:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522654336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518135.286215:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518135.286278:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522654336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518135.286285:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518135.286291:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789518135.286300:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522654208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518135.286321:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518135.286356:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522654208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518135.286362:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789518135.286594:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522654208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518135.286608:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522654336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518135.287707:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518135.294330:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522654464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518135.294416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518135.294681:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654464 00000100:00100000:2.0:1789518135.294690:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654464 00000100:00100000:2.0:1789518135.294749:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789518135.294759:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522654464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518135.294790:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518135.294857:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522654464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518135.294864:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1789518135.295043:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f73100 x1876445522654464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518135.295063:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522654464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518135.349701:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789518136.177243:0:12499:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518136.177964:0:12499:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789518136.384085:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518137.400658:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518137.846214:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518137.846239:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522654592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518137.847128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518137.847199:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654592 00000100:00100000:2.0:1789518137.847208:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654592 00000100:00080000:1.0:1789518137.847347:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518137.847383:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789518137.847396:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522654592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518137.847430:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518137.847509:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522654592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518137.847516:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1789518137.847753:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f73100 x1876445522654592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518137.847789:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522654592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518138.259842:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518138.259889:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518138.259916:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518138.259934:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518138.259950:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603968 00000100:00100000:3.0:1789518138.259965:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603968 00000100:00100000:3.0:1789518138.260050:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604224 00000100:00100000:3.0:1789518138.260053:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604224 00000100:00100000:3.0:1789518138.260080:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 161 00000100:00100000:2.0:1789518138.260087:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518138.260110:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501603968:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518138.260242:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603712 00000100:00100000:0.0:1789518138.260247:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603712 00000100:00100000:0.0:1789518138.260276:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 309 00000100:00100000:0.0:1789518138.260281:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2390:x1876445501603712:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518138.260349:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501603968:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 242us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518138.260372:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 161 00000100:00100000:3.0:1789518138.260395:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501603840 00000100:00100000:3.0:1789518138.260398:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501603840 00000100:00100000:3.0:1789518138.260420:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00100000:3.0:1789518138.260427:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604224:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518138.260501:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518138.267382:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2390:x1876445501603712:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 6815us (7279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518138.267418:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 309 00000100:00100000:0.0:1789518138.267561:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604096 00000100:00100000:0.0:1789518138.267574:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604096 00000100:00100000:0.0:1789518138.267631:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:0.0:1789518138.267656:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501603840:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518138.267729:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501603840:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 79us (7775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518138.267736:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:0.0:1789518138.267755:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:0.0:1789518138.267762:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604096:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518138.267789:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604096:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (7288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518138.267795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:0.0:1789518138.267817:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604480 00000100:00100000:0.0:1789518138.267823:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604480 00000100:00100000:0.0:1789518138.268219:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:0.0:1789518138.268227:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604480:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518138.268260:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604480:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 34us (8324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518138.268267:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:3.0:1789518138.270136:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604224:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 9692us (10200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518138.270155:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00080000:3.0:1789518138.270210:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518138.270217:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518138.270220:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518138.279222:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518138.283804:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604352 00000100:00100000:0.0:1789518138.283841:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604352 00000100:00100000:0.0:1789518138.284249:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:0.0:1789518138.284263:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604352:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518138.284404:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501604352:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 143us (5198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518138.284544:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00080000:1.0:1789518138.284607:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1789518138.398580:0:12597:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518138.399230:0:12597:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789518138.421932:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518139.382952:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522654720:0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.383046:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518139.383101:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522655232:0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.383147:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518139.383177:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522655744:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383199:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522654976:0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.383200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518139.383218:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522656256:0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.383236:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383290:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522655488:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383317:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383334:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522656000:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383367:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383391:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789518139.383396:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522655104:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383434:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383452:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522655616:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383498:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383519:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522656128:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383567:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522654848:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383590:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383602:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522655360:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383620:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383640:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522655872:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383668:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522656384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518139.383688:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518139.383724:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522655232 00000100:00100000:0.0:1789518139.383742:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522655232 00000100:00100000:0.0:1789518139.383789:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654976 00000100:00100000:0.0:1789518139.383792:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654976 00000100:00100000:0.0:1789518139.383811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789518139.383821:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522655232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383879:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522655232:12345-0@lo:400:kworker.0 Request processed in 59us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518139.383891:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789518139.383910:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518139.383916:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522654976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.383949:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522654976:12345-0@lo:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518139.383955:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518139.383972:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522655488 00000100:00100000:0.0:1789518139.383975:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522655488 00000100:00100000:0.0:1789518139.384004:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656000 00000100:00100000:0.0:1789518139.384007:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656000 00000100:00100000:2.0:1789518139.384152:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522655744 00000100:00100000:2.0:1789518139.384157:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522655744 00000100:00100000:2.0:1789518139.384180:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656256 00000100:00100000:2.0:1789518139.384183:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656256 00000100:00100000:2.0:1789518139.384194:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656128 00000100:00100000:2.0:1789518139.384196:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656128 00000100:00100000:2.0:1789518139.384206:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522655360 00000100:00100000:2.0:1789518139.384207:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522655360 00000100:00100000:2.0:1789518139.384219:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789518139.384226:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522655744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518139.384262:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522655744:12345-0@lo:400:kworker.0 Request processed in 37us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518139.384267:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789518139.384279:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789518139.384285:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522656256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518139.384310:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522656256:12345-0@lo:400:kworker.0 Request processed in 26us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518139.384315:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789518139.384325:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789518139.384330:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522656128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518139.384366:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522656128:12345-0@lo:400:kworker.0 Request processed in 35us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518139.384371:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789518139.384381:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789518139.384387:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522655360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518139.384418:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522655360:12345-0@lo:400:kworker.0 Request processed in 32us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518139.384435:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1789518139.384506:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e5500 x1876445522655360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518139.384520:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522655360:0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.384590:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522655232:0@lo:400:kworker.0 00010000:00080000:1.0:1789518139.384601:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6d80 x1876445522655744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518139.384609:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522655744:0@lo:400:kworker.0 00010000:00080000:1.0:1789518139.384617:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f87a300 x1876445522656256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518139.384623:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522656256:0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.384651:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654720 00000100:00100000:1.0:1789518139.384654:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654720 00000100:00100000:1.0:1789518139.384692:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789518139.384699:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522654720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.384744:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522654720:12345-0@lo:400:kworker.0 Request processed in 46us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518139.384750:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789518139.384768:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303558380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522654720:0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.384796:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656384 00000100:00100000:1.0:1789518139.384801:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656384 00000100:00100000:1.0:1789518139.384822:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789518139.384829:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522656384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518139.384850:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518139.384879:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522655104 00000100:00100000:0.0:1789518139.384883:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522655104 00000100:00100000:1.0:1789518139.384895:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522656384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518139.384899:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522655616 00000100:00100000:1.0:1789518139.384901:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789518139.384902:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522655616 00000100:00100000:0.0:1789518139.384914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522654848 00000100:00080000:1.0:1789518139.384917:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518139.384917:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522654848 00000100:00080000:1.0:1789518139.384921:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518139.384924:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518139.384926:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518139.384926:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522655872 00000100:00100000:0.0:1789518139.384928:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522655872 00000100:00100000:1.0:1789518139.384958:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789518139.384966:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522655488:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789518139.384974:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303546a00 x1876445522656384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518139.384988:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522656384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518139.384995:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522655488:12345-0@lo:400:kworker.0 Request processed in 31us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518139.385000:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789518139.385014:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789518139.385021:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522656000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.385050:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522656000:12345-0@lo:400:kworker.0 Request processed in 30us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518139.385055:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789518139.385065:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789518139.385070:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522655104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518139.385096:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522655104:12345-0@lo:400:kworker.0 Request processed in 25us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518139.385102:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789518139.393291:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789518139.393311:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522655616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.393421:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522655616:12345-0@lo:400:kworker.0 Request processed in 118us (9922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518139.393438:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789518139.393459:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789518139.393486:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522654848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.393541:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522654848:12345-0@lo:400:kworker.0 Request processed in 57us (9950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518139.393548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789518139.393560:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789518139.393566:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522655872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.393598:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522655872:12345-0@lo:400:kworker.0 Request processed in 32us (9939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518139.393603:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789518139.393656:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522655104:0@lo:400:kworker.0 00010000:00080000:0.0:1789518139.393671:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e4380 x1876445522655616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518139.393680:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522655616:0@lo:400:kworker.0 00010000:00080000:0.0:1789518139.393693:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f879f80 x1876445522656128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518139.393700:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522656128:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.393710:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522654976:0@lo:400:kworker.0 00000100:00100000:0.0:1789518139.393721:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522655488:0@lo:400:kworker.0 00010000:00080000:0.0:1789518139.393731:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e5f80 x1876445522656000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518139.393752:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522656000:0@lo:400:kworker.0 00000100:00080000:0.0:1789518139.393806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518139.396605:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522654848:0@lo:400:kworker.0 00000100:00100000:2.0:1789518139.396631:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522655872:0@lo:400:kworker.0 00010000:00010000:0.0:1789518139.446935:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518139.893680:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518139.893704:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522656512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518139.893777:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518139.893882:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656512 00000100:00100000:3.0:1789518139.893892:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656512 00000100:00100000:3.0:1789518139.895444:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789518139.895475:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522656512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518139.895503:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518139.895576:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522656512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518139.895583:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1789518139.895714:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e90000 x1876445522656512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518139.895734:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522656512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518140.406041:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522656768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518140.406101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518140.406172:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656768 00000100:00100000:2.0:1789518140.406181:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656768 00000100:00100000:2.0:1789518140.406222:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789518140.406230:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522656768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518140.406264:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518140.406329:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522656768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518140.406334:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789518140.406408:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522656768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518140.406455:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522656896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518140.406500:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518140.407525:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518140.407542:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522656640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518140.407588:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518140.407686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656640 00000100:00100000:2.0:1789518140.407694:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656640 00000100:00100000:2.0:1789518140.407741:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518140.407750:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522656640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518140.407785:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789518140.407832:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522656640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518140.407839:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518140.407879:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522656640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518140.409680:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522656896 00000100:00100000:0.0:1789518140.409700:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522656896 00000100:00100000:0.0:1789518140.409775:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789518140.409789:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522656896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518140.409822:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518140.409900:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522656896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518140.409908:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1789518140.410078:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f83ed80 x1876445522656896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518140.410100:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522656896:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1789518140.457609:0:12694:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518140.458411:0:12694:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789518140.470774:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518141.499004:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518142.524115:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789518142.542293:0:12791:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518142.542599:0:12791:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789518142.965796:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518142.965818:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522657024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518142.965893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518142.966145:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657024 00000100:00100000:2.0:1789518142.966154:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657024 00000100:00100000:2.0:1789518142.966218:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789518142.966231:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522657024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518142.966260:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518142.966308:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522657024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.966314:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1789518142.966374:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f83ed80 x1876445522657024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518142.966392:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522657024:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789518142.966441:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518143.385190:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518143.385236:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518143.385262:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518143.385289:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518143.385308:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518143.385344:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518143.385370:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518143.385399:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604736 00000100:00100000:2.0:1789518143.385402:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604864 00000100:00100000:0.0:1789518143.385409:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604736 00000100:00100000:2.0:1789518143.385412:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604864 00000100:00100000:2.0:1789518143.385492:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604992 00000100:00100000:2.0:1789518143.385496:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604992 00000100:00100000:1.0:1789518143.385644:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501604608 00000100:00100000:1.0:1789518143.385649:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501604608 00000100:00100000:1.0:1789518143.385687:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 311 00000100:00100000:1.0:1789518143.385696:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501604608:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518143.385769:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501604608:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 73us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518143.385775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 311 00000100:00100000:1.0:1789518143.385818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501605120 00000100:00100000:1.0:1789518143.385822:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501605120 00000100:00100000:0.0:1789518143.394707:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 171 00000100:00100000:0.0:1789518143.394723:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501604864:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518143.394815:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501604864:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 97us (9551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518143.394825:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 171 00000100:00100000:0.0:1789518143.394844:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 172 00000100:00100000:0.0:1789518143.394851:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501604736:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518143.394877:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501604736:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (9641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518143.394883:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 172 00000100:00100000:0.0:1789518143.394913:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501605248 00000100:00100000:0.0:1789518143.394922:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501605248 00000100:00100000:0.0:1789518143.394967:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501605376 00000100:00100000:0.0:1789518143.394971:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501605376 00000100:00100000:0.0:1789518143.394995:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:0.0:1789518143.395002:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2386:x1876445501605248:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:0.0:1789518143.395024:0:8429:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314323 00000100:00080000:0.0:1789518143.395036:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e7437794000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518143.395087:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789518143.395183:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 173 00000100:00100000:2.0:1789518143.395196:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501604992:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518143.395245:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+2:2386:x1876445501605248:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 233us (9889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518143.395252:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:0.0:1789518143.395266:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789518143.395273:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2386:x1876445501605376:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:0.0:1789518143.395285:0:8429:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231432a 00000100:00080000:0.0:1789518143.395292:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e7437797800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518143.395376:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:3.0:1789518143.396332:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518143.396339:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501604992:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 1143us (11044us total) trans 0 rc 0/0 00000100:00080000:3.0:1789518143.396340:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518143.396345:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518143.396350:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518143.396357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 173 00000100:00100000:0.0:1789518143.396982:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+2:2386:x1876445501605376:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 1706us (11608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518143.396993:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00010000:00010000:0.0:1789518143.397033:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518143.397041:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518143.400407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 174 00000100:00100000:1.0:1789518143.400423:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501605120:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518143.400513:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501605120:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 95us (15204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518143.400520:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 174 00010000:00010000:0.0:1789518143.543278:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518144.501741:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518144.501766:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522657152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518144.501847:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.501910:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657152 00000100:00100000:2.0:1789518144.501917:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657152 00000100:00100000:2.0:1789518144.501968:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789518144.501991:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522657152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518144.502020:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518144.502064:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522657152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.502071:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789518144.502092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789518144.502122:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f83ed80 x1876445522657152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518144.502141:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522657152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518144.505759:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522657280:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.505841:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.505894:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522657792:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.505959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.505982:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522658304:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.506007:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.506036:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789518144.506042:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522657408:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.506066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.506086:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522657920:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.506106:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.506124:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522658432:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.506146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.506178:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657792 00000100:00100000:2.0:1789518144.506186:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657792 00000100:00100000:2.0:1789518144.506228:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789518144.506236:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522657792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.506289:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522657792:12345-0@lo:400:kworker.0 Request processed in 52us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.506496:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657280 00000100:00100000:3.0:1789518144.506501:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657280 00000100:00100000:3.0:1789518144.506528:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789518144.506535:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522657280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518144.506570:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522657280:12345-0@lo:400:kworker.0 Request processed in 36us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.506576:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789518144.507273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522657664:0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.507325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518144.507358:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522658176:0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.507379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518144.507399:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522658688:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.507415:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789518144.507423:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518144.507449:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789518144.507453:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658304 00000100:00100000:1.0:1789518144.507458:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522657536:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.507460:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658304 00000100:00100000:1.0:1789518144.507526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.507533:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657920 00000100:00100000:2.0:1789518144.507538:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657920 00000100:00100000:1.0:1789518144.507553:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522658048:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.507557:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658688 00000100:00100000:2.0:1789518144.507561:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658688 00000100:00100000:1.0:1789518144.507579:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518144.507598:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518144.507598:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522658560:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.507612:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522658304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.507625:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518144.507654:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657408 00000100:00100000:1.0:1789518144.507658:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657408 00000100:00100000:2.0:1789518144.507664:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522658304:12345-0@lo:400:kworker.0 Request processed in 53us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.507672:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789518144.507689:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518144.507691:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658432 00000100:00100000:1.0:1789518144.507696:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658432 00000100:00100000:2.0:1789518144.507700:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522657920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.507715:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657664 00000100:00100000:1.0:1789518144.507719:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657664 00000100:00100000:1.0:1789518144.507736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658176 00000100:00100000:2.0:1789518144.507738:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522657920:12345-0@lo:400:kworker.0 Request processed in 40us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.507740:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658176 00000100:00100000:2.0:1789518144.507749:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518144.507760:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658048 00000100:00100000:1.0:1789518144.507763:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658048 00000100:00100000:2.0:1789518144.507768:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789518144.507779:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522658688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.507783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658560 00000100:00100000:1.0:1789518144.507788:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658560 00000100:00100000:1.0:1789518144.507810:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789518144.507819:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522657408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.507823:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522658688:12345-0@lo:400:kworker.0 Request processed in 46us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.507831:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789518144.507856:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789518144.507865:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522657408:12345-0@lo:400:kworker.0 Request processed in 47us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.507868:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522658432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.507878:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789518144.507897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789518144.507907:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522657664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.507914:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522658432:12345-0@lo:400:kworker.0 Request processed in 47us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.507922:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789518144.507941:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789518144.507947:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522657664:12345-0@lo:400:kworker.0 Request processed in 41us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.507953:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522658176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.507959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789518144.507976:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789518144.507992:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522658048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.507998:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522658176:12345-0@lo:400:kworker.0 Request processed in 47us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.508006:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789518144.508036:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789518144.508037:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522658048:12345-0@lo:400:kworker.0 Request processed in 45us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.508047:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522658560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.508048:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789518144.508078:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522657536 00000100:00100000:1.0:1789518144.508084:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522657536 00000100:00100000:2.0:1789518144.508091:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522658560:12345-0@lo:400:kworker.0 Request processed in 46us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.508098:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789518144.508113:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789518144.508121:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522657536:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518144.508140:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518144.508145:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518144.508147:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518144.508149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518144.508346:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522657536:12345-0@lo:400:kworker.0 Request processed in 224us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.508353:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789518144.508388:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522657536:0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.508397:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522658048:0@lo:400:kworker.0 00010000:00080000:1.0:1789518144.508407:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404811c00 x1876445522658560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518144.508418:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522658560:0@lo:400:kworker.0 00000100:00100000:1.0:1789518144.508427:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522657664:0@lo:400:kworker.0 00010000:00080000:1.0:1789518144.508435:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e91180 x1876445522658176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518144.508443:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522658176:0@lo:400:kworker.0 00010000:00080000:1.0:1789518144.508451:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404813b80 x1876445522658688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518144.508458:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522658688:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.509966:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522657408:0@lo:400:kworker.0 00010000:00080000:2.0:1789518144.510001:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e93800 x1876445522657920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518144.510010:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522657920:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.510024:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522658432:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.510034:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522657280:0@lo:400:kworker.0 00000100:00100000:2.0:1789518144.510045:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522657792:0@lo:400:kworker.0 00010000:00080000:2.0:1789518144.510057:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404813100 x1876445522658304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518144.510065:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522658304:0@lo:400:kworker.0 00010000:00010000:0.0:1789518144.566904:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789518144.857367:0:12889:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789518144.857644:0:12889:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789518145.016380:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518145.016402:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522658816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518145.017876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518145.020219:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658816 00000100:00100000:3.0:1789518145.020239:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658816 00000100:00100000:3.0:1789518145.022315:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789518145.022334:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522658816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518145.022362:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518145.022453:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522658816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518145.022461:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1789518145.026483:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404810000 x1876445522658816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518145.026511:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522658816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518145.535076:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522658944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518145.535216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518145.535312:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522658944 00000100:00100000:2.0:1789518145.535321:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522658944 00000100:00100000:2.0:1789518145.535370:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518145.535380:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522658944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518145.535418:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789518145.535489:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522658944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518145.535496:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518145.535653:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522658944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518145.539553:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522659072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518145.539681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518145.539771:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659072 00000100:00100000:1.0:1789518145.539783:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659072 00000100:00100000:1.0:1789518145.539842:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789518145.539853:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522659072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518145.539894:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518145.539996:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522659072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518145.540004:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789518145.540064:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522659072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518145.547535:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518145.547562:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522659200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518145.547650:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518145.547716:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659200 00000100:00100000:0.0:1789518145.547726:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659200 00000100:00100000:0.0:1789518145.547778:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789518145.547788:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522659200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518145.547827:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518145.547885:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522659200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518145.547892:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1789518145.547961:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e744160c700 x1876445522659200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518145.547983:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522659200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789518145.590743:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518146.615278:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518147.647096:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518148.086094:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522659328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518148.086167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518148.086583:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659328 00000100:00100000:2.0:1789518148.086594:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659328 00000100:00100000:0.0:1789518148.088687:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789518148.088707:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522659328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789518148.088749:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518148.088863:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522659328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518148.088871:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1789518148.088919:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6680 x1876445522659328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518148.088940:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522659328:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789518148.096849:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518148.521291:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518148.521342:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518148.521374:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518148.521402:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501605760 00000100:00100000:1.0:1789518148.521413:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501605760 00000100:00100000:1.0:1789518148.521494:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606016 00000100:00100000:1.0:1789518148.521497:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606016 00000100:00100000:1.0:1789518148.521525:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:1.0:1789518148.521534:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501605760:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518148.521604:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501605760:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518148.521624:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:1.0:1789518148.521641:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00100000:1.0:1789518148.521647:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501606016:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518148.521672:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501606016:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518148.521678:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00080000:1.0:1789518148.521693:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518148.521725:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518148.521786:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518148.522228:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501605504 00000100:00100000:3.0:1789518148.522235:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501605504 00000100:00100000:0.0:1789518148.522344:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501605632 00000100:00100000:0.0:1789518148.522350:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501605632 00000100:00100000:0.0:1789518148.522907:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501605888 00000100:00100000:0.0:1789518148.522913:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501605888 00000100:00100000:0.0:1789518148.522946:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 183 00000100:00100000:0.0:1789518148.522954:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2389:x1876445501605632:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518148.523000:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2389:x1876445501605632:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 47us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518148.523006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 183 00000100:00100000:0.0:1789518148.523021:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 184 00000100:00100000:0.0:1789518148.523027:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501605888:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518148.523049:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501605888:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518148.523055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 184 00000100:00080000:0.0:1789518148.523072:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518148.529200:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 313 00000100:00100000:3.0:1789518148.529221:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501605504:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518148.529784:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501605504:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 568us (8504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518148.529794:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 313 00010000:00010000:0.0:1789518148.664839:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518148.779999:0:13033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1789518149.116459:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000020:00000080:2.0:1789518149.116511:0:9506:0:(genops.c:885:class_export_put()) final put ffff8e7437792800/b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000020:00000080:0.0:1789518149.116562:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7437792800/b5627b1d-cf97-43a8-8382-f16e6ba3aeed for lustre-OST0001 00000020:00000080:0.0:1789518149.116676:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7437797800 for lustre-OST0001 00000001:00100000:0.0:1789518149.117228:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000020:00000080:0.0:1789518149.117235:0:8421:0:(genops.c:885:class_export_put()) final put ffff8e7437795800/b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000020:00000080:2.0:1789518149.117351:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7437795800/b5627b1d-cf97-43a8-8382-f16e6ba3aeed for lustre-OST0000 00000020:00000080:2.0:1789518149.119739:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7437794000 for lustre-OST0000 00000100:00100000:1.0:1789518149.621826:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522659456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518149.621925:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518149.622068:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659456 00000100:00100000:2.0:1789518149.622081:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659456 00000100:00100000:2.0:1789518149.622161:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789518149.622173:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522659456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518149.622215:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518149.622283:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522659456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.622291:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789518149.622680:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789518149.622735:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e4a80 x1876445522659456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518149.622759:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522659456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518149.624218:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522659840:0@lo:400:kworker.0 00000100:00100000:2.0:1789518149.624318:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522659584:0@lo:400:kworker.0 00000100:00100000:3.0:1789518149.624331:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518149.624358:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518149.624400:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518149.624407:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522659712:0@lo:400:kworker.0 00000100:00100000:2.0:1789518149.624432:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518149.624491:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659840 00000100:00100000:2.0:1789518149.624501:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659840 00000100:00100000:2.0:1789518149.624549:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789518149.624561:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522659840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.624670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659584 00000100:00100000:1.0:1789518149.624674:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659584 00000100:00100000:1.0:1789518149.624712:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789518149.624720:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522659584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.624775:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522659584:12345-0@lo:400:kworker.0 Request processed in 55us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518149.624783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789518149.624845:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522659584:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.624886:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522659968:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.624914:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518149.624950:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659712 00000100:00100000:1.0:1789518149.624954:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659712 00000100:00100000:1.0:1789518149.624982:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522659968 00000100:00100000:1.0:1789518149.624985:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522659968 00000100:00100000:1.0:1789518149.625005:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789518149.625011:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522659712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.625047:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522659712:12345-0@lo:400:kworker.0 Request processed in 36us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518149.625054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789518149.625067:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789518149.625072:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522659968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.625103:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522659968:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518149.625109:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789518149.625144:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522659712:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.625165:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522659968:0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.628459:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522660224:0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.628591:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518149.628640:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522660736:0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.628668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518149.628694:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789518149.628700:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522660096:0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.628839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518149.628864:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522660608:0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.628889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518149.629003:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660096 00000100:00100000:0.0:1789518149.629014:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660096 00000100:00100000:0.0:1789518149.629073:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789518149.629086:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522660096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.629150:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522660096:12345-0@lo:400:kworker.0 Request processed in 65us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518149.629157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789518149.629183:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660224 00000100:00100000:0.0:1789518149.629187:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660224 00000100:00100000:0.0:1789518149.629228:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660608 00000100:00100000:0.0:1789518149.629231:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660608 00000100:00100000:0.0:1789518149.629249:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789518149.629266:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522660224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.629297:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522660224:12345-0@lo:400:kworker.0 Request processed in 43us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518149.629304:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789518149.629316:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789518149.629321:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522660608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.629369:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522660608:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518149.629375:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789518149.629405:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518149.629439:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522660096:0@lo:400:kworker.0 00010000:00080000:0.0:1789518149.629454:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480dc00 x1876445522660608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518149.629605:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522660480:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.629648:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518149.629675:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522660992:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.629698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518149.629716:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789518149.629733:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522660352:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.629765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518149.629783:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522660864:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.629805:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518149.629834:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660736 00000100:00100000:1.0:1789518149.629838:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660736 00000100:00100000:1.0:1789518149.629871:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660480 00000100:00100000:1.0:1789518149.629874:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660480 00000100:00100000:1.0:1789518149.629886:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660352 00000100:00100000:1.0:1789518149.629889:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660352 00000100:00100000:1.0:1789518149.629902:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660864 00000100:00100000:1.0:1789518149.629905:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660864 00000100:00100000:2.0:1789518149.631201:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522659840:12345-0@lo:400:kworker.0 Request processed in 6632us (6859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.631216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789518149.631420:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522660992 00000100:00100000:2.0:1789518149.631430:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522660992 00000100:00100000:2.0:1789518149.631514:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789518149.631525:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522660992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518149.631632:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522660992:12345-0@lo:400:kworker.0 Request processed in 109us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.631639:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789518149.631703:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518149.631709:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518149.631846:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789518149.631856:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522660736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.631901:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522660736:12345-0@lo:400:kworker.0 Request processed in 47us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518149.631907:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789518149.631934:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1789518149.632437:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518149.632490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789518149.632503:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522660352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518149.632558:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522660352:12345-0@lo:400:kworker.0 Request processed in 59us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.632565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789518149.632584:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789518149.632590:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522660864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518149.632645:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522660864:12345-0@lo:400:kworker.0 Request processed in 55us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.632651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789518149.632832:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522660352:0@lo:400:kworker.0 00010000:00080000:2.0:1789518149.632851:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480ca80 x1876445522660864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518149.632865:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522660864:0@lo:400:kworker.0 00010000:00080000:2.0:1789518149.632879:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480df80 x1876445522660992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518149.632888:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522660992:0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.633066:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522660608:0@lo:400:kworker.0 00010000:00080000:0.0:1789518149.633090:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e744160d500 x1876445522660224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518149.633098:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522660224:0@lo:400:kworker.0 00000100:00100000:0.0:1789518149.633112:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522660736:0@lo:400:kworker.0 00000100:00100000:3.0:1789518149.636705:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522659840:0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.641885:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522660480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518149.646812:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522660480:12345-0@lo:400:kworker.0 Request processed in 14854us (17147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518149.646834:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00010000:00080000:2.0:1789518149.647220:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e744160c700 x1876445522660480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518149.647242:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522660480:0@lo:400:kworker.0 00010000:00010000:0.0:1789518149.691100:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518150.142689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522661120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518150.142806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518150.142922:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522661120 00000100:00100000:1.0:1789518150.142933:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522661120 00000100:00100000:1.0:1789518150.143011:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789518150.143022:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522661120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518150.143090:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518150.143146:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522661120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518150.143154:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1789518150.143213:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7404813480 x1876445522661120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518150.143235:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522661120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518150.646436:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522661248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518150.646535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518150.646609:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522661248 00000100:00100000:1.0:1789518150.646616:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522661248 00000100:00100000:1.0:1789518150.646661:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789518150.646670:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522661248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518150.646702:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518150.646749:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522661248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518150.646756:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789518150.646817:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522661248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518150.649427:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518150.649449:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522661376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518150.649546:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518150.651524:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518150.651545:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522661504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518150.651605:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518150.651653:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522661376 00000100:00100000:2.0:1789518150.651661:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522661376 00000100:00100000:2.0:1789518150.651715:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789518150.651724:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522661376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518150.651759:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518150.651799:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522661376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518150.651814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789518150.651839:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522661504 00000100:00100000:2.0:1789518150.651842:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522661504 00000100:00100000:2.0:1789518150.651864:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789518150.651870:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522661504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518150.651887:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518150.651921:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522661504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518150.651927:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1789518150.651964:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302836300 x1876445522661504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518150.651981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522661504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518150.654782:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522661376:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789518150.710639:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518151.740737:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518152.757696:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518153.205723:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518153.205746:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522661632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518153.205810:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518153.205917:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522661632 00000100:00100000:2.0:1789518153.205926:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522661632 00000100:00100000:2.0:1789518153.205991:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789518153.206002:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522661632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518153.206031:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518153.206076:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522661632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518153.206083:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789518153.206281:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518153.206312:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6d80 x1876445522661632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518153.206330:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522661632:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1789518153.325815:0:13181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff901ffca0 20000000:00000080:0.0:1789518153.326017:0:13181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e73019eb000 uarg=0000000000000000 20000000:01000000:0.0:1789518153.326061:0:13181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789518153.326068:0:13181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789518153.326072:0:13181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789518153.326974:0:13182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789518153.327130:0:13181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789518153.335851:0:13181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789518153.336782:0:13181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336808:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336829:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336836:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336843:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336850:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336857:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336880:0:13181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336933:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.336949:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.336964:0:13181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404811180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522661760:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518153.337069:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.337078:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.337087:0:13181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404813b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522661888:0@lo:104: 00000100:00100000:3.0:1789518153.337125:0:13181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518153.337519:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.337530:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.337539:0:13181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662016:0@lo:104: 00000100:00100000:3.0:1789518153.337562:0:13181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518153.340899:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.340939:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.340952:0:13181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662144:0@lo:104: 00000100:00100000:3.0:1789518153.341004:0:13181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518153.341623:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522661888 00000100:00100000:0.0:1789518153.341633:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522661888 00000100:00100000:0.0:1789518153.341682:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522662016 00000100:00100000:0.0:1789518153.341686:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522662016 00000100:00100000:0.0:1789518153.341698:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518153.341707:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:13181:x1876445522661888:12345-0@lo:104: 00010000:00010000:0.0:1789518153.341721:0:10332:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.341780:0:10332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518153.341787:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:13181:x1876445522661888:12345-0@lo:104: Request processed in 81us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518153.341794:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518153.341811:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518153.343123:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:13181:x1876445522662016:12345-0@lo:104: 00010000:00010000:0.0:1789518153.343345:0:10332:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.343727:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.343740:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 23 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.343756:0:13181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662272:0@lo:104: 00000100:00100000:3.0:1789518153.343792:0:13181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518153.343813:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.343925:0:10332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518153.343932:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:13181:x1876445522662016:12345-0@lo:104: Request processed in 2115us (6369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518153.343941:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518153.343972:0:10332:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518153.343984:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522662144 00000100:00100000:0.0:1789518153.344003:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522662144 00000100:00100000:0.0:1789518153.344032:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522662272 00000100:00100000:0.0:1789518153.344035:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522662272 00000100:00100000:0.0:1789518153.344047:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518153.344053:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:13181:x1876445522662144:12345-0@lo:104: 00010000:00010000:0.0:1789518153.344061:0:10332:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518153.344171:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518153.344180:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303479450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:13181:x1876445522662272:12345-0@lo:104: 00010000:00010000:3.0:1789518153.344525:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.344535:0:13181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662400:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518153.344714:0:13181:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518153.344737:0:13181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404811180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522661760:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518153.344747:0:13181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404813b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522661888:0@lo:104: 00000100:00100000:3.0:1789518153.344755:0:13181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662016:0@lo:104: 00000100:00100000:3.0:1789518153.344760:0:13181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662144:0@lo:104: 00010000:00010000:1.0:1789518153.344846:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.345447:0:13181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662272:0@lo:104: 00000100:00100000:3.0:1789518153.346797:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518153.349170:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518153.349523:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606144 00000100:00100000:3.0:1789518153.349534:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606144 00010000:00010000:3.0:1789518153.349575:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 13 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.349617:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606272 00000100:00100000:3.0:1789518153.349621:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606272 00010000:00010000:3.0:1789518153.349637:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 14 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.349658:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:3.0:1789518153.349667:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+14:2387:x1876445501606144:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518153.349680:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518153.349686:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 14 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.349699:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 14 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.349717:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400031e00/0x8d0fd6794231430e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566026 expref: 14 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.349733:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518153.349780:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501606144:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 113us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518153.349792:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:3.0:1789518153.349810:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789518153.349831:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:2388:x1876445501606272:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518153.349840:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518153.349844:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.349851:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 12 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.349860:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518153.349879:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:2388:x1876445501606272:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 49us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518153.349885:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00010000:00010000:3.0:1789518153.350019:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcf400/0x8d0fd679423142c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe7 expref: 11 pid: 6507 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.350030:0:13181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1876445522662400:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518153.350064:0:13181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.351575:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789518153.351587:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.351613:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0cc00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518153.351618:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.351627:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518153.351633:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518153.351639:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789518153.351698:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.351705:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518153.351729:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.351736:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0cc00/0x8d0fd679423142f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518153.351754:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518153.351772:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522662528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518153.351998:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518153.352086:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789518153.352090:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.352096:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518153.352108:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.352114:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518153.352120:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518153.352124:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789518153.352159:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.352165:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518153.352182:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518153.352317:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c200/0x8d0fd679423142e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518153.352337:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522662656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518153.352367:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518153.352441:0:10332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518153.352451:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:13181:x1876445522662144:12345-0@lo:104: Request processed in 8396us (11446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518153.352474:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789518153.352542:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789518153.352551:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303479450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:13181:x1876445522662272:12345-0@lo:104: Request processed in 8371us (8757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518153.352566:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518153.353003:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522662528 00000100:00100000:3.0:1789518153.353011:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522662528 00010000:00010000:3.0:1789518153.353042:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 24 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.353062:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522662656 00000100:00100000:3.0:1789518153.353064:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522662656 00010000:00010000:3.0:1789518153.353075:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 25 pid: 6507 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518153.353089:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518153.353105:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3639:x1876445522662528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518153.353118:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518153.353123:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 25 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.353135:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 25 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.353162:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dce000/0x8d0fd679423142f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423142f2 expref: 25 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.353174:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518153.353344:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522662528:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518153.353351:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518153.353368:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789518153.353374:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:3637:x1876445522662656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518153.353383:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518153.353387:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.353395:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.353405:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d000/0x8d0fd679423142eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423142e4 expref: 23 pid: 6507 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.353414:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518153.353441:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3637:x1876445522662656:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518153.353453:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1789518153.353571:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518153.353577:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353585:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ce00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518153.353588:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353596:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518153.353603:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518153.353608:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518153.353632:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353637:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518153.353655:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353662:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423142d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353679:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518153.353682:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353688:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518153.353690:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353696:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518153.353702:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518153.353707:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518153.353720:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353725:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518153.353736:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353742:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9da00/0x8d0fd679423142c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423142cf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.353766:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518153.353773:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518153.353775:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518153.353797:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522662784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518153.353840:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518153.353874:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518153.353883:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522662912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518153.353919:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518153.353942:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522662784 00000100:00100000:0.0:1789518153.353947:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522662784 00010000:00010000:0.0:1789518153.353962:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 22 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518153.353976:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522662912 00000100:00100000:0.0:1789518153.353978:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522662912 00010000:00010000:0.0:1789518153.353988:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 23 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518153.353997:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518153.354002:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:3638:x1876445522662784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518153.354008:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518153.354011:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354018:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354027:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423142dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423142d6 expref: 23 pid: 6505 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354036:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518153.354068:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3638:x1876445522662784:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518153.354074:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518153.354089:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518153.354095:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3640:x1876445522662912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518153.354102:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518153.354106:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 21 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354115:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 21 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354124:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030800/0x8d0fd679423142cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423142c8 expref: 21 pid: 6506 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354135:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354453:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354497:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354504:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354510:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354517:0:9516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354527:0:9516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518153.354532:0:9516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354539:0:9516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354550:0:9516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518153.354560:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518153.354589:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3640:x1876445522662912:12345-0@lo:103:ldlm_bl.0 Request processed in 494us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518153.354596:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518153.354649:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522662784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518153.354671:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522662912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518153.354700:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518153.354829:0:13181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.354838:0:13181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518153.354844:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400031600/0x8d0fd67942314331 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518153.360392:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522662528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518153.360431:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522662656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518153.364345:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518153.364352:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518153.364355:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518153.622264:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518153.622304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518153.622326:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518153.622350:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518153.622445:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606400 00000100:00100000:2.0:1789518153.622456:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606400 00000100:00100000:2.0:1789518153.622563:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606656 00000100:00100000:2.0:1789518153.622567:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606656 00000100:00100000:2.0:1789518153.622582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606528 00000100:00100000:2.0:1789518153.622585:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606528 00000100:00100000:2.0:1789518153.622598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606784 00000100:00100000:2.0:1789518153.622600:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606784 00000100:00100000:2.0:1789518153.622618:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:2.0:1789518153.622627:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501606400:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518153.622707:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501606400:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 80us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518153.622716:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:2.0:1789518153.622734:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 192 00000100:00100000:2.0:1789518153.622741:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501606656:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518153.622767:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501606656:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518153.622774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 192 00000100:00100000:2.0:1789518153.622786:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:2.0:1789518153.622792:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501606528:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518153.622815:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501606528:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518153.622834:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:2.0:1789518153.622847:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00100000:2.0:1789518153.622853:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501606784:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518153.622878:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501606784:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518153.622906:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00080000:3.0:1789518153.623391:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518153.623396:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789518153.781692:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518154.643725:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518154.643879:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501606912 00000100:00100000:0.0:1789518154.643948:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501606912 00000100:00100000:0.0:1789518154.645073:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 315 00000100:00100000:0.0:1789518154.645088:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+11:6162:x1876445501606912:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518154.645106:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518154.645136:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566057 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.645166:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.645187:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.645197:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9ce00, rc 0) 00000100:00100000:0.0:1789518154.645281:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501606912:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 196us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.645288:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 315 00000100:00100000:3.0:1789518154.654628:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518154.675994:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607040 00000100:00100000:1.0:1789518154.676011:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607040 00000100:00100000:1.0:1789518154.676086:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 316 00000100:00100000:1.0:1789518154.676096:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501607040:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518154.676413:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501607040:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 317us (21795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.676422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 316 00000100:00100000:3.0:1789518154.681738:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 10000000:01000000:2.0:1789518154.682907:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518154.682913:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e730205a000 from 7 10000000:01000000:2.0:1789518154.682918:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518154.682961:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.682973:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.682986:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518154.683010:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518154.683064:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518154.683127:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518154.683154:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607168 00000100:00100000:2.0:1789518154.683160:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607168 00000100:00100000:2.0:1789518154.683190:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663040 00000100:00100000:2.0:1789518154.683193:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663040 00000100:00100000:2.0:1789518154.683386:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 317 00000100:00100000:2.0:1789518154.683397:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501607168:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518154.683542:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501607168:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 145us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.683549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 317 00000100:00100000:2.0:1789518154.683576:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789518154.683582:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522663040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518154.683599:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518154.683612:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231433f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.683635:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231433f expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.683645:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231433f expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.683654:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac400, rc 0) 00000100:00100000:2.0:1789518154.683687:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522663040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.683693:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789518154.683730:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518154.683744:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.683753:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518154.684043:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518154.684071:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518154.684099:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518154.684307:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663168 00000100:00100000:0.0:1789518154.684313:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663168 00000100:00100000:0.0:1789518154.684340:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789518154.684348:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522663168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.684438:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522663168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.684445:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789518154.684505:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.684531:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.684570:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518154.684584:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518154.684597:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663296 00000100:00100000:0.0:1789518154.684601:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663296 00000100:00100000:0.0:1789518154.684618:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789518154.684623:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522663296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.684690:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522663296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.684706:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789518154.684738:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518154.685650:0:13199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789518154.686025:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789518154.686048:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518154.686058:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.686084:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518154.686094:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518154.686096:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7435dc1800 from 7 10000000:01000000:2.0:1789518154.686099:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518154.686140:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.686149:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.686159:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518154.686178:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518154.686312:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518154.686378:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393900 going to sleep for 11 seconds 00000100:00100000:0.0:1789518154.686570:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663424 00000100:00100000:0.0:1789518154.686578:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663424 00000100:00100000:2.0:1789518154.686821:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789518154.686831:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522663424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518154.686843:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518154.686854:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231434d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.686882:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231434d expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.686905:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231434d expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.686921:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033adc00, rc 0) 00000100:00100000:2.0:1789518154.687005:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522663424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.687012:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789518154.687192:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518154.687282:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.687293:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518154.687432:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518154.687551:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518154.687608:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73037429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518154.687643:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663552 00000100:00100000:2.0:1789518154.687648:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663552 00000100:00100000:2.0:1789518154.687706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789518154.687714:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522663552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518154.687824:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522663552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.687831:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789518154.687894:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.687924:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.687964:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518154.688104:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405f3f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518154.688147:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663680 00000100:00100000:1.0:1789518154.688152:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663680 00000100:00100000:1.0:1789518154.688174:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789518154.688180:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522663680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518154.688279:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522663680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.688292:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789518154.688423:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518154.689422:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789518154.689728:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789518154.689748:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518154.689756:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.689768:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518154.689777:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518154.689787:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e74044cd800 from 7 10000000:01000000:0.0:1789518154.689790:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518154.689817:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.689824:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.689835:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518154.689852:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.690042:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518154.690078:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405f3f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518154.690159:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663808 00000100:00100000:1.0:1789518154.690165:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663808 00000100:00100000:1.0:1789518154.690222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789518154.690231:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522663808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518154.690242:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518154.690263:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231435b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518154.690285:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231435b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518154.690295:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231435b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518154.690302:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c000, rc 0) 00000100:00100000:1.0:1789518154.690344:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522663808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.690351:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789518154.690644:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518154.690658:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.690667:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518154.690723:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.690752:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518154.690774:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405f3f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518154.691004:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522663936 00000100:00100000:1.0:1789518154.691010:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522663936 00000100:00100000:1.0:1789518154.691044:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789518154.691052:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522663936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518154.691162:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522663936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.691170:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789518154.691253:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522663936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518154.691283:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518154.691326:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518154.691351:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518154.691453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664064 00000100:00100000:1.0:1789518154.691457:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664064 00000100:00100000:1.0:1789518154.691512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789518154.691518:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522664064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518154.691589:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522664064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.691596:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789518154.691669:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518154.692628:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789518154.692839:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789518154.692860:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518154.692869:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518154.692968:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518154.692979:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518154.692982:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7439644800 from 7 10000000:01000000:3.0:1789518154.692984:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518154.693014:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518154.693022:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518154.693031:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518154.693050:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518154.693093:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518154.693131:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518154.693181:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664192 00000100:00100000:0.0:1789518154.693188:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664192 00000100:00100000:0.0:1789518154.693289:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789518154.693297:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522664192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518154.693316:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518154.693327:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942314369 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.693346:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942314369 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.693355:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314369 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.693363:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d200, rc 0) 00000100:00100000:0.0:1789518154.693399:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522664192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.693406:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789518154.693442:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518154.693453:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.693480:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518154.693529:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.693556:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518154.693571:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c256c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518154.693584:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664320 00000100:00100000:0.0:1789518154.693588:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664320 00000100:00100000:0.0:1789518154.693609:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789518154.693615:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522664320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.693711:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522664320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.693718:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789518154.693745:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.693768:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.693805:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518154.693818:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c256c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518154.693830:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664448 00000100:00100000:0.0:1789518154.693833:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664448 00000100:00100000:0.0:1789518154.693853:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789518154.693859:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522664448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.694705:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522664448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 842us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.694715:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789518154.694858:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522664448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518154.695840:0:13202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789518154.697553:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789518154.697584:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518154.697595:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518154.697608:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518154.715117:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518154.715670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607296 00000100:00100000:3.0:1789518154.715682:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607296 00000100:00100000:3.0:1789518154.715755:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 330 00000100:00100000:3.0:1789518154.715766:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501607296:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518154.715786:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518154.715805:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856605e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518154.715836:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518154.715867:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518154.715890:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031600, rc 0) 00000100:00100000:3.0:1789518154.715953:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501607296:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 189us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518154.715960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 330 00000100:00100000:3.0:1789518154.718366:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518154.718509:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607424 00000100:00100000:0.0:1789518154.718520:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607424 00000100:00100000:0.0:1789518154.718569:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 331 00000100:00100000:0.0:1789518154.718579:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501607424:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.718733:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501607424:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 155us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.718741:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 331 00000100:00100000:1.0:1789518154.728012:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518154.728052:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607552 00000100:00100000:0.0:1789518154.728063:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607552 00000100:00100000:0.0:1789518154.728169:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 332 00000100:00100000:0.0:1789518154.728180:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501607552:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518154.728331:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501607552:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 153us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.728339:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 332 00000100:00100000:1.0:1789518154.741822:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522664704:0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.741822:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522664576:0@lo:400:kworker.0 00000100:00100000:3.0:1789518154.741913:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522664960:0@lo:400:kworker.0 00000100:00100000:1.0:1789518154.742083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518154.742143:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522665216:0@lo:400:kworker.0 00000100:00100000:1.0:1789518154.742169:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518154.742195:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522665728:0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.742237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518154.742238:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522664832:0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.742262:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522665088:0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.742286:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518154.742287:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664704 00000100:00100000:2.0:1789518154.742297:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664704 00000100:00100000:0.0:1789518154.742307:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522665600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.742338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518154.742347:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518154.742356:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522664704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.742358:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522666112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518154.742379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518154.742405:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522664704:12345-0@lo:400:kworker.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.742408:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665088 00000100:00100000:0.0:1789518154.742411:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665088 00000100:00100000:2.0:1789518154.742412:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518154.742433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665216 00000100:00100000:2.0:1789518154.742436:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665216 00000100:00100000:0.0:1789518154.742447:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789518154.742453:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522665088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.742456:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664576 00000100:00100000:2.0:1789518154.742458:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664576 00000100:00100000:2.0:1789518154.742495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665600 00000100:00100000:2.0:1789518154.742498:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665600 00000100:00100000:0.0:1789518154.742508:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522665088:12345-0@lo:400:kworker.0 Request processed in 55us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.742512:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789518154.742518:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522665216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.742531:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789518154.742561:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522665216:12345-0@lo:400:kworker.0 Request processed in 43us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.742568:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:0.0:1789518154.742577:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302837b80 x1876445522665088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518154.742579:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789518154.742585:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522664576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.742591:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522665088:0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.742608:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522664576:12345-0@lo:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.742613:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789518154.742622:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522664576:0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.742623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789518154.742629:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522665600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.742655:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522665600:12345-0@lo:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.742661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789518154.742677:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522665600:0@lo:400:kworker.0 00000100:00080000:2.0:1789518154.742693:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518154.742697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518154.743189:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518154.743315:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522665344:0@lo:400:kworker.0 00000100:00100000:1.0:1789518154.743340:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518154.743505:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522665856:0@lo:400:kworker.0 00000100:00100000:1.0:1789518154.743528:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518154.743616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518154.743640:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522665472:0@lo:400:kworker.0 00000100:00100000:3.0:1789518154.743664:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518154.743681:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522665984:0@lo:400:kworker.0 00000100:00100000:3.0:1789518154.743700:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518154.743727:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665856 00000100:00100000:3.0:1789518154.743733:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665856 00000100:00100000:0.0:1789518154.743761:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665472 00000100:00100000:3.0:1789518154.743766:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665984 00000100:00100000:0.0:1789518154.743766:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665472 00000100:00100000:3.0:1789518154.743768:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665984 00000100:00100000:3.0:1789518154.743782:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789518154.743788:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522665856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.743789:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789518154.743794:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522665984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518154.743836:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522665856:12345-0@lo:400:kworker.0 Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.743836:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522665984:12345-0@lo:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.743842:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789518154.743979:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789518154.743993:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789518154.743999:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522665472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518154.744038:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522665472:12345-0@lo:400:kworker.0 Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518154.744044:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1789518154.744072:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302836d80 x1876445522665472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518154.744083:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522665472:0@lo:400:kworker.0 00010000:00080000:3.0:1789518154.744092:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f23100 x1876445522665984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518154.744099:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522665984:0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.744159:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664832 00000100:00100000:2.0:1789518154.744164:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664832 00000100:00100000:2.0:1789518154.744185:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665344 00000100:00100000:2.0:1789518154.744187:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665344 00000100:00100000:2.0:1789518154.745341:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789518154.745364:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522664832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.745427:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522664832:12345-0@lo:400:kworker.0 Request processed in 74us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.745578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789518154.745589:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522665344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518154.745624:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522665344:12345-0@lo:400:kworker.0 Request processed in 39us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.745630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789518154.745647:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522666112 00000100:00100000:0.0:1789518154.745656:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522666112 00000100:00100000:1.0:1789518154.745671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522664960 00000100:00100000:1.0:1789518154.745675:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522664960 00000100:00100000:0.0:1789518154.745694:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789518154.745698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518154.745700:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522666112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518154.745703:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522664960:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789518154.745725:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518154.745739:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522664960:12345-0@lo:400:kworker.0 Request processed in 35us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.745757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518154.745761:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522666112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (3381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.745766:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789518154.745797:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522664832:0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.745835:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1789518154.745869:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518154.745874:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518154.745998:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518154.746092:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522664704:0@lo:400:kworker.0 00000100:00100000:0.0:1789518154.746105:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522665216:0@lo:400:kworker.0 00010000:00080000:0.0:1789518154.746151:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6680 x1876445522666112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518154.746168:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522666112:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789518154.746431:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302835c00 x1876445522665344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518154.746442:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522665344:0@lo:400:kworker.0 00010000:00080000:1.0:1789518154.746454:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f23800 x1876445522665856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518154.746457:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522665728 00000100:00100000:1.0:1789518154.746462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522665856:0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.746487:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522665728 00000100:00100000:1.0:1789518154.746511:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522664960:0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.746585:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789518154.746592:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522665728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518154.746645:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522665728:12345-0@lo:400:kworker.0 Request processed in 50us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.746653:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:0.0:1789518154.746730:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f21500 x1876445522665728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518154.746739:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522665728:0@lo:400:kworker.0 00000100:00080000:3.0:1789518154.746741:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789518154.806490:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518155.260745:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522666240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518155.261689:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518155.261949:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522666240 00000100:00100000:3.0:1789518155.261960:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522666240 00000100:00100000:3.0:1789518155.262019:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789518155.262029:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522666240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518155.262054:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518155.262111:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522666240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518155.262119:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1789518155.262162:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73036dc000 x1876445522666240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518155.262181:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522666240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518155.765927:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518155.765993:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522666368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518155.766110:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518155.766192:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522666368 00000100:00100000:1.0:1789518155.766211:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522666368 00000100:00100000:1.0:1789518155.766262:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789518155.766271:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522666368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518155.766310:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518155.766367:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522666368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518155.766374:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789518155.766430:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522666368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518155.767072:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518155.767102:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522666496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518155.767149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518155.767251:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522666496 00000100:00100000:3.0:1789518155.767257:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522666496 00000100:00100000:3.0:1789518155.767299:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789518155.767307:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522666496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518155.767339:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518155.767383:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522666496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518155.767390:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789518155.767425:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522666496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518155.769495:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518155.769521:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522666624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518155.769600:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518155.773502:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522666624 00000100:00100000:2.0:1789518155.773520:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522666624 00000100:00100000:2.0:1789518155.773601:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789518155.773612:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522666624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518155.773650:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518155.773756:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522666624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (4154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518155.773764:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1789518155.773998:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302834700 x1876445522666624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518155.774021:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522666624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789518155.829733:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518156.854375:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518157.878941:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518158.270620:0:13380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789518158.333950:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522666752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518158.334053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518158.334233:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522666752 00000100:00100000:2.0:1789518158.334241:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522666752 00000100:00100000:2.0:1789518158.334321:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789518158.334330:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522666752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518158.334360:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518158.334423:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522666752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518158.334637:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789518158.334681:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6680 x1876445522666752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518158.334701:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522666752:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789518158.334991:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518158.743612:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518158.743653:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518158.743686:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518158.743714:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518158.743740:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518158.743776:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607936 00000100:00100000:1.0:1789518158.743787:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607936 00000100:00100000:1.0:1789518158.743846:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608192 00000100:00100000:1.0:1789518158.743849:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608192 00000100:00100000:1.0:1789518158.743864:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607808 00000100:00100000:1.0:1789518158.743866:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607808 00000100:00100000:1.0:1789518158.743878:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608064 00000100:00100000:1.0:1789518158.743880:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608064 00000100:00100000:1.0:1789518158.743896:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:1.0:1789518158.743905:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501607936:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518158.743987:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501607936:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518158.743994:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:1.0:1789518158.744011:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:1.0:1789518158.744017:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501608192:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518158.744074:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501608192:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 56us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518158.744080:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:1.0:1789518158.744092:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:1.0:1789518158.744097:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501607808:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518158.744124:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501607808:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518158.744129:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:1.0:1789518158.744139:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 204 00000100:00100000:1.0:1789518158.744145:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501608064:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518158.744166:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501608064:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518158.744180:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 204 00000100:00080000:1.0:1789518158.744197:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518158.744201:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518158.745155:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501607680 00000100:00100000:3.0:1789518158.745164:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501607680 00000100:00100000:3.0:1789518158.745223:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 333 00000100:00100000:3.0:1789518158.745232:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2390:x1876445501607680:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518158.745283:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2390:x1876445501607680:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 52us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518158.745291:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 333 00010000:00010000:0.0:1789518158.901738:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518159.862077:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518159.862104:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522666880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518159.862208:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518159.862316:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522666880 00000100:00100000:2.0:1789518159.862327:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522666880 00000100:00100000:2.0:1789518159.862403:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789518159.862417:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522666880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518159.862459:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518159.862627:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522666880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.862636:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789518159.862847:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789518159.862897:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6680 x1876445522666880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518159.862920:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522666880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518159.866427:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518159.868203:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522667136:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.868291:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.868362:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522667008:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.868393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518159.868580:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667136 00000100:00100000:0.0:1789518159.868590:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667136 00000100:00100000:0.0:1789518159.868660:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789518159.868671:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522667136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518159.868740:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522667136:12345-0@lo:400:kworker.0 Request processed in 71us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518159.868746:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789518159.869181:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667008 00000100:00100000:3.0:1789518159.869188:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667008 00000100:00100000:3.0:1789518159.869234:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789518159.869242:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522667008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.869278:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522667008:12345-0@lo:400:kworker.0 Request processed in 37us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.869283:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789518159.869331:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522667136:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.869340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522667008:0@lo:400:kworker.0 00000100:00100000:2.0:1789518159.869790:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522667392:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.870004:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522667264:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.870081:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.870110:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522667776:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.870141:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667264 00000100:00100000:3.0:1789518159.870147:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667264 00000100:00100000:0.0:1789518159.870402:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522667520:0@lo:400:kworker.0 00000100:00100000:0.0:1789518159.870433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518159.870594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.870716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667520 00000100:00100000:3.0:1789518159.870721:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667520 00000100:00100000:3.0:1789518159.870741:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789518159.870749:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522667264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.871632:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522667264:12345-0@lo:400:kworker.0 Request processed in 879us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.871644:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789518159.871671:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789518159.871679:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522667520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.871717:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522667520:12345-0@lo:400:kworker.0 Request processed in 40us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.871735:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789518159.871763:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.871805:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522668288:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.871849:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.871904:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522667264:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.871932:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667392 00000100:00100000:3.0:1789518159.871937:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667392 00000100:00100000:3.0:1789518159.871968:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667776 00000100:00100000:3.0:1789518159.871971:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667776 00000100:00100000:3.0:1789518159.871991:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668288 00000100:00100000:3.0:1789518159.871994:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668288 00000100:00100000:3.0:1789518159.872008:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789518159.872014:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522667392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872047:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522667392:12345-0@lo:400:kworker.0 Request processed in 33us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.872053:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789518159.872063:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789518159.872069:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522667776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872112:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522667776:12345-0@lo:400:kworker.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.872117:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789518159.872130:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789518159.872135:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522668288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872174:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522668288:12345-0@lo:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.872181:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1789518159.872208:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518159.872213:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518159.872232:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522667776:0@lo:400:kworker.0 00010000:00080000:3.0:1789518159.872245:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480df80 x1876445522668288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518159.872256:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522668288:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872277:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522667648:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.872326:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522668160:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872344:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.872370:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667648 00000100:00100000:3.0:1789518159.872374:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667648 00000100:00100000:3.0:1789518159.872407:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789518159.872413:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522667648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872448:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522667648:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.872454:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789518159.872501:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518159.872508:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668160 00000100:00100000:3.0:1789518159.872511:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668160 00000100:00100000:3.0:1789518159.872536:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789518159.872541:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522668160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872573:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522668160:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.872578:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:3.0:1789518159.872593:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789518159.872616:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e7480 x1876445522667648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518159.872625:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522667648:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.872634:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522668160:0@lo:400:kworker.0 00000100:00100000:0.0:1789518159.876446:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522667520:0@lo:400:kworker.0 00000100:00100000:0.0:1789518159.876498:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522668032:0@lo:400:kworker.0 00000100:00100000:0.0:1789518159.876572:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.876765:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668032 00000100:00100000:3.0:1789518159.876776:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668032 00000100:00100000:3.0:1789518159.876850:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789518159.876868:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522668032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.876933:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522668032:12345-0@lo:400:kworker.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.876941:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1789518159.879498:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480e300 x1876445522668032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518159.879518:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522668032:0@lo:400:kworker.0 00000100:00100000:2.0:1789518159.879846:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522667392:0@lo:400:kworker.0 00000100:00100000:2.0:1789518159.880024:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522667904:0@lo:400:kworker.0 00000100:00100000:2.0:1789518159.880088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518159.880131:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522668416:0@lo:400:kworker.0 00000100:00100000:2.0:1789518159.880156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518159.880320:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668416 00000100:00100000:0.0:1789518159.880329:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668416 00000100:00100000:0.0:1789518159.880416:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789518159.880428:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522668416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518159.880536:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522668416:12345-0@lo:400:kworker.0 Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518159.880543:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789518159.880638:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789518159.880993:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480ca80 x1876445522668416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518159.881005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522668416:0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.881105:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522667904 00000100:00100000:3.0:1789518159.881112:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522667904 00000100:00100000:3.0:1789518159.881181:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789518159.881189:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522667904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518159.881253:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522667904:12345-0@lo:400:kworker.0 Request processed in 65us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.881260:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1789518159.881379:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789518159.881527:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e6680 x1876445522667904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518159.881538:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522667904:0@lo:400:kworker.0 00010000:00010000:2.0:1789518159.927107:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518160.374977:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518160.375004:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522668544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518160.375089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518160.375573:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668544 00000100:00100000:3.0:1789518160.375583:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668544 00000100:00100000:3.0:1789518160.375634:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789518160.375644:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522668544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518160.375667:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518160.375713:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522668544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.375720:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1789518160.375773:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480ca80 x1876445522668544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518160.375792:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522668544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518160.885786:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522668672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518160.886342:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522668800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518160.886417:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518160.888622:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522668928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518160.888692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518160.889279:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668928 00000100:00100000:3.0:1789518160.889288:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668928 00000100:00100000:3.0:1789518160.889358:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789518160.889369:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522668928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518160.889401:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518160.889456:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522668928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.889492:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1789518160.889846:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e740480e300 x1876445522668928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518160.889864:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522668928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518160.890539:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518160.897846:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668672 00000100:00100000:1.0:1789518160.897864:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668672 00000100:00100000:1.0:1789518160.897998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522668800 00000100:00100000:1.0:1789518160.898003:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522668800 00000100:00100000:3.0:1789518160.898201:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789518160.898214:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522668672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518160.898257:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789518160.898362:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522668672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (12493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.898369:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789518160.898387:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789518160.898394:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522668800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518160.898411:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518160.898444:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522668672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518160.898452:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522668800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (7915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.898486:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789518160.898529:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522668800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789518160.949745:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518161.976446:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518162.997772:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518163.445706:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518163.445741:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522669056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518163.445906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518163.446028:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669056 00000100:00100000:3.0:1789518163.446036:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669056 00000100:00100000:3.0:1789518163.446101:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789518163.446125:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522669056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518163.446162:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518163.446211:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522669056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518163.446218:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789518163.446255:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f23100 x1876445522669056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518163.446274:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522669056:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789518163.446643:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518163.860188:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518163.860229:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518163.860324:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608320 00000100:00100000:2.0:1789518163.860336:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608320 00000100:00100000:2.0:1789518163.860394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 335 00000100:00100000:2.0:1789518163.860403:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501608320:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518163.860494:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501608320:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 91us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518163.860501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 335 00000100:00100000:1.0:1789518163.860700:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518163.861271:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518163.861412:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608576 00000100:00100000:0.0:1789518163.861419:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608576 00000100:00100000:0.0:1789518163.861490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608832 00000100:00100000:0.0:1789518163.861493:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608832 00000100:00100000:0.0:1789518163.861514:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:0.0:1789518163.861521:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501608576:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518163.861567:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501608576:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 46us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518163.861574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:0.0:1789518163.861587:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00100000:0.0:1789518163.861606:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501608832:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518163.861628:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501608832:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518163.861633:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00080000:2.0:1789518163.861905:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518163.861984:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518163.862051:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608448 00000100:00100000:2.0:1789518163.862055:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608448 00000100:00100000:2.0:1789518163.862089:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608704 00000100:00100000:2.0:1789518163.862092:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608704 00000100:00100000:2.0:1789518163.862108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 213 00000100:00100000:2.0:1789518163.862174:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501608448:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518163.862208:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501608448:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 37us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518163.862214:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 213 00000100:00100000:2.0:1789518163.862227:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 214 00000100:00100000:2.0:1789518163.862234:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501608704:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518163.862388:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501608704:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 154us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518163.862395:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 214 00000100:00080000:1.0:1789518163.862458:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518164.028544:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518164.112028:0:13528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:22:42 (1789518162) === 00000100:00100000:0.0:1789518164.501369:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.501499:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518164.501711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501609088 00000100:00100000:1.0:1789518164.501722:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501609088 00000100:00100000:1.0:1789518164.501778:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:1.0:1789518164.501845:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5499dd84-083f-4a57-a16b-aad857025063+6:10480:x1876445501609088:12345-192.168.202.43@tcp:700:mkdir.0 00000100:00100000:1.0:1789518164.501935:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5499dd84-083f-4a57-a16b-aad857025063+6:10480:x1876445501609088:12345-192.168.202.43@tcp:700:mkdir.0 Request processed in 95us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518164.501943:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:2.0:1789518164.503424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501608960 00000100:00100000:2.0:1789518164.503437:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501608960 00000100:00100000:2.0:1789518164.503521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:2.0:1789518164.503531:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501608960:12345-192.168.202.43@tcp:41:mkdir.0 00000004:00000024:2.0:1789518164.503567:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789518164.503653:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501608960:12345-192.168.202.43@tcp:41:mkdir.0 Request processed in 123us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518164.503661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:3.0:1789518164.515200:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.515653:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501609344 00000100:00100000:2.0:1789518164.515665:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501609344 00000100:00100000:2.0:1789518164.515724:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:2.0:1789518164.515735:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:10480:x1876445501609344:12345-192.168.202.43@tcp:36:mkdir.0 00010000:00010000:2.0:1789518164.515807:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518164.515878:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314220 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fd2 expref: 6 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.515900:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b7c00) 00010000:00010000:2.0:1789518164.515912:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518164.515996:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516010:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516034:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516065:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516072:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516080:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516638:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516649:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516656:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518164.516670:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000531a2207 reply state 0000000028075610 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516682:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516688:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e73010b9400) 00010000:00010000:2.0:1789518164.516691:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518164.516694:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789518164.516700:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789518164.516706:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516719:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516725:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516731:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518164.516735:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516741:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516750:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9100) 00010000:00010000:2.0:1789518164.516753:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518164.516756:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516762:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231437e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518164.516775:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000531a2207 reply state 0000000028075610 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516782:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.516788:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e73010b9300) 00010000:00010000:2.0:1789518164.516790:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518164.516792:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789518164.516863:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+7:10480:x1876445501609344:12345-192.168.202.43@tcp:36:mkdir.0 Request processed in 1130us (1673us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789518164.516876:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:3.0:1789518164.530512:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.530619:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501609472 00000100:00100000:2.0:1789518164.530629:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501609472 00000100:00100000:2.0:1789518164.530681:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:2.0:1789518164.530691:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+7:10481:x1876445501609472:12345-192.168.202.43@tcp:101:chmod.0 00010000:00010000:2.0:1789518164.530713:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518164.530736:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566065 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.530813:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231439a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.530827:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231439a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.530839:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231439a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518164.530882:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518164.530886:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518164.530929:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231439a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.530956:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566065 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.530976:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231439a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566065 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.531003:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9100) 00010000:00010000:2.0:1789518164.531006:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518164.531009:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad000, rc 0) 00000100:00100000:2.0:1789518164.531075:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+8:10481:x1876445501609472:12345-192.168.202.43@tcp:101:chmod.0 Request processed in 386us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518164.531082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789518164.536091:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.536179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501609728 00000100:00100000:2.0:1789518164.536199:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501609728 00000100:00100000:2.0:1789518164.536261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:2.0:1789518164.536271:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+8:10481:x1876445501609728:12345-192.168.202.43@tcp:36:chmod.0 00010000:00010000:2.0:1789518164.536323:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518164.536348:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231439a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566065 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.536367:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9100) 00010000:00010000:2.0:1789518164.536377:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518164.536575:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.536589:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.536600:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518164.536880:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eac21c7a reply state 000000007f5d8149 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.536906:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.536912:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:2.0:1789518164.536915:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789518164.536918:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789518164.536927:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789518164.537012:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+9:10481:x1876445501609728:12345-192.168.202.43@tcp:36:chmod.0 Request processed in 741us (930us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789518164.537021:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:1.0:1789518164.567301:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.567423:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501609856 00000100:00100000:2.0:1789518164.567437:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501609856 00000100:00100000:2.0:1789518164.567538:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:2.0:1789518164.567546:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+9:10482:x1876445501609856:12345-192.168.202.43@tcp:101:chown.0 00010000:00010000:2.0:1789518164.567572:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518164.567592:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd679423143a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856606c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.567654:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423143af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.567666:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423143af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.567675:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423143af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518164.567722:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518164.567725:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518164.567795:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423143af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.567818:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd679423143a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856606c expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.567834:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423143af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856606c expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.567840:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:2.0:1789518164.567843:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518164.567846:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad400, rc 0) 00000100:00100000:2.0:1789518164.567916:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+10:10482:x1876445501609856:12345-192.168.202.43@tcp:101:chown.0 Request processed in 371us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518164.567921:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789518164.577813:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.579678:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501609984 00000100:00100000:2.0:1789518164.579699:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501609984 00000100:00100000:2.0:1789518164.579782:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:2.0:1789518164.579794:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+10:10482:x1876445501609984:12345-192.168.202.43@tcp:101:chown.0 00010000:00010000:2.0:1789518164.579818:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518164.579844:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566073 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580054:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580070:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580081:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580108:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580125:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580218:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580227:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580233:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518164.580271:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518164.580274:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518164.580302:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580315:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580322:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580330:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580346:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518164.580351:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580359:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580372:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:2.0:1789518164.580375:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518164.580380:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580386:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423143bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580410:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580416:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580422:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580427:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518164.580430:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580436:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580454:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e73010b9300) 00010000:00010000:2.0:1789518164.580456:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518164.580459:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580508:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423143c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580536:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566073 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580550:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566073 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.580558:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e73010b9400) 00010000:00010000:2.0:1789518164.580560:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518164.580562:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033acc00, rc 0) 00000100:00100000:2.0:1789518164.580633:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+11:10482:x1876445501609984:12345-192.168.202.43@tcp:101:chown.0 Request processed in 839us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518164.580639:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:1.0:1789518164.591099:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.591198:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501610112 00000100:00100000:0.0:1789518164.591214:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501610112 00000100:00100000:0.0:1789518164.591301:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:0.0:1789518164.591316:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5499dd84-083f-4a57-a16b-aad857025063+11:10482:x1876445501610112:12345-192.168.202.43@tcp:900:chown.0 00000100:00100000:0.0:1789518164.591433:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5499dd84-083f-4a57-a16b-aad857025063+11:10482:x1876445501610112:12345-192.168.202.43@tcp:900:chown.0 Request processed in 120us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.591441:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:0.0:1789518164.602514:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.602771:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501610368 00000100:00100000:2.0:1789518164.602788:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501610368 00000100:00100000:2.0:1789518164.602877:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:2.0:1789518164.602895:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+11:10482:x1876445501610368:12345-192.168.202.43@tcp:36:chown.0 00010000:00010000:2.0:1789518164.602960:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518164.602987:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566073 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.603027:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e73010b9400) 00010000:00010000:2.0:1789518164.603032:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518164.603056:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.603068:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.603078:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518164.606915:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1789518164.607432:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607451:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607460:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607572:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ada00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518164.607577:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607603:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607626:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e73010b9300) 00010000:00010000:3.0:1789518164.607629:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518164.607636:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607644:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314385 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607674:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607682:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607687:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607693:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518164.607696:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607703:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607767:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e73010b9400) 00010000:00010000:3.0:1789518164.607770:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518164.607775:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607857:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231438c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607875:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607881:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607887:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607892:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518164.607895:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607901:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607909:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:3.0:1789518164.607912:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518164.607915:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.607921:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423143a1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518164.608323:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000826859fe reply state 00000000320d4c23 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.608351:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.608360:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e73010b9400) 00010000:00010000:2.0:1789518164.608363:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789518164.608368:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789518164.608381:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789518164.608513:0:6515:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789518164.608537:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+7:10482:x1876445501610368:12345-192.168.202.43@tcp:36:chown.0 Request processed in 5644us (6072us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789518164.608546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00010000:00010000:3.0:1789518164.608589:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.608601:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.608618:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.608623:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518164.608627:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.608634:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.608645:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e73010b9400) 00010000:00010000:3.0:1789518164.608648:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518164.608652:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.608659:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423143d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518164.631140:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.634013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501610496 00000100:00100000:2.0:1789518164.634333:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501610496 00000100:00100000:2.0:1789518164.634565:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:2.0:1789518164.634580:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+6:10483:x1876445501610496:12345-192.168.202.43@tcp:101:touch.500 00010000:00010000:2.0:1789518164.634642:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518164.634672:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856607a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518164.641618:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6872us 00010000:00010000:3.0:1789518164.690906:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.690950:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.690967:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.690991:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691012:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691020:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691169:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd679423143ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691179:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd679423143ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691188:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd679423143ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518164.691228:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789518164.691234:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518164.691282:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd679423143ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691297:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691304:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691311:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691316:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518164.691321:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691337:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691352:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:3.0:1789518164.691356:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518164.691363:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691369:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423143e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691397:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691403:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691410:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691415:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518164.691418:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691424:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691431:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e743b22ea00) 00010000:00010000:3.0:1789518164.691434:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518164.691437:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691453:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423143e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691557:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423143d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856607a expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691579:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd679423143ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856607a expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.691588:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:3.0:1789518164.691591:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518164.691594:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf600, rc 0) 00000100:00100000:3.0:1789518164.691692:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+7:10483:x1876445501610496:12345-192.168.202.43@tcp:101:touch.500 Request processed in 57114us (60573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518164.691703:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:0.0:1789518164.699125:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518164.699211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501610752 00000100:00100000:1.0:1789518164.699237:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501610752 00000100:00100000:1.0:1789518164.699440:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:1.0:1789518164.699454:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+7:10483:x1876445501610752:12345-192.168.202.43@tcp:101:touch.500 00010000:00010000:1.0:1789518164.699511:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518164.699545:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd679423143f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518164.699697:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518164.701943:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518164.702000:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.712426:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.713023:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.713049:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518164.714842:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789518164.715437:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231440a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715461:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231440a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715506:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231440a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715558:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715565:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715572:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715579:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518164.715585:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715594:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715610:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:0.0:1789518164.715613:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518164.715621:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715661:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d200/0x8d0fd679423143fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518164.715848:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fbd07aa reply state 0000000076e5843b transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715862:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.715868:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff8e73032eed00) 00010000:00010000:0.0:1789518164.715870:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518164.715875:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518164.716057:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd679423143f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566081 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.716078:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231440a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566081 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.716086:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e73032ee200) 00010000:00010000:0.0:1789518164.716089:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518164.716091:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c200, rc 0) 00000100:00100000:0.0:1789518164.716435:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+10:10483:x1876445501610752:12345-192.168.202.43@tcp:101:touch.500 Request processed in 16981us (17331us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789518164.716446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:2.0:1789518164.725021:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518164.725170:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501611008 00000100:00100000:3.0:1789518164.725184:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501611008 00000100:00100000:3.0:1789518164.725263:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:3.0:1789518164.725276:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+10:10483:x1876445501611008:12345-192.168.202.43@tcp:36:touch.500 00010000:00010000:3.0:1789518164.725352:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518164.725389:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231440a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566081 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.725423:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e73032ee200) 00010000:00010000:3.0:1789518164.725437:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518164.725584:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.725621:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.725635:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518164.728197:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c85614b9 reply state 000000007e44fe86 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.728232:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.728242:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e743b22ea00) 00010000:00010000:3.0:1789518164.728246:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518164.728251:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518164.728432:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+11:10483:x1876445501611008:12345-192.168.202.43@tcp:36:touch.500 Request processed in 3153us (3421us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789518164.728443:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:2.0:1789518164.735660:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.736126:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501611136 00000100:00100000:0.0:1789518164.736142:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501611136 00000100:00100000:0.0:1789518164.736267:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:0.0:1789518164.736279:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+11:10483:x1876445501611136:12345-192.168.202.43@tcp:101:touch.500 00010000:00010000:0.0:1789518164.736330:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518164.736358:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231441f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566088 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.736450:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231441f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566088 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.736504:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231441f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566088 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.736527:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e743b22ea00) 00010000:00010000:0.0:1789518164.736532:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518164.736539:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9ca00, rc 0) 00000100:00100000:0.0:1789518164.736624:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+12:10483:x1876445501611136:12345-192.168.202.43@tcp:101:touch.500 Request processed in 346us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.736632:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:1.0:1789518164.739135:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518164.739220:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501611264 00000100:00100000:3.0:1789518164.739230:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501611264 00000100:00100000:3.0:1789518164.739281:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:3.0:1789518164.739289:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b59e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876445501611264:12345-192.168.202.43@tcp:8:touch.500 00010000:00080000:3.0:1789518164.739322:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:3.0:1789518164.739358:0:8429:0:(genops.c:1384:class_connect()) connect: client 5499dd84-083f-4a57-a16b-aad857025063, cookie 0x8d0fd67942314426 00002000:00100000:3.0:1789518164.739370:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5499dd84-083f-4a57-a16b-aad857025063/ffff8e7303551800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518164.739387:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518164.739458:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518164.739533:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e7303554800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518164.739603:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b59e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2386:x1876445501611264:12345-192.168.202.43@tcp:8:touch.500 Request processed in 314us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518164.739610:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:3.0:1789518164.742174:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.742407:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501611392 00000100:00100000:0.0:1789518164.742416:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501611392 00000100:00100000:0.0:1789518164.742512:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789518164.742524:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+6:0:x1876445501611392:12345-192.168.202.43@tcp:2:touch.500 00000100:00080000:1.0:1789518164.742954:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789518164.754930:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1789518164.754955:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000100:00100000:0.0:1789518164.755266:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:0:x1876445501611392:12345-192.168.202.43@tcp:2:touch.500 Request processed in 12732us (13087us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789518164.755280:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:2.0:1789518164.768054:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.768304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501611648 00000100:00100000:0.0:1789518164.768320:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501611648 00000100:00100000:0.0:1789518164.768406:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:0.0:1789518164.768422:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+12:10483:x1876445501611648:12345-192.168.202.43@tcp:35:touch.500 00000100:00100000:0.0:1789518164.780633:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+13:10483:x1876445501611648:12345-192.168.202.43@tcp:35:touch.500 Request processed in 12195us (12580us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789518164.780655:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:1.0:1789518164.818518:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518164.818741:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501611776 00000100:00100000:3.0:1789518164.818757:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501611776 00000100:00100000:3.0:1789518164.818916:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:3.0:1789518164.818929:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+13:10484:x1876445501611776:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:3.0:1789518164.818962:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518164.818993:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dce000/0x8d0fd6794231442d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856608f expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.819086:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.819103:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.819129:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518164.819187:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789518164.819192:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518164.819394:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.819431:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dce000/0x8d0fd6794231442d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856608f expref: 15 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.819515:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856608f expref: 14 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.819526:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:3.0:1789518164.819529:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518164.819534:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf400, rc 0) 00000100:00100000:3.0:1789518164.819754:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+14:10484:x1876445501611776:12345-192.168.202.43@tcp:101:rm.0 Request processed in 827us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518164.819763:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:2.0:1789518164.825972:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.827377:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501612032 00000100:00100000:0.0:1789518164.827401:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501612032 00000100:00100000:0.0:1789518164.827545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:0.0:1789518164.827560:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+14:10484:x1876445501612032:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:0.0:1789518164.827589:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518164.827619:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd6794231443b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566096 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518164.827767:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789518164.835102:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd6794231443b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566096 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.835146:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:2.0:1789518164.835150:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518164.835157:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd6794231443b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566096 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.835185:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c600, rc 0) 00000100:00100000:2.0:1789518164.835303:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+15:10484:x1876445501612032:12345-192.168.202.43@tcp:101:rm.0 Request processed in 7746us (9345us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789518164.835315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:0.0:1789518164.839632:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.839764:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501612160 00000100:00100000:2.0:1789518164.839779:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501612160 00000100:00100000:2.0:1789518164.839855:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:2.0:1789518164.839868:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+15:10484:x1876445501612160:12345-192.168.202.43@tcp:37:rm.0 00000100:00100000:2.0:1789518164.845619:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+15:10484:x1876445501612160:12345-192.168.202.43@tcp:37:rm.0 Request processed in 5736us (5987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518164.845656:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:3.0:1789518164.851858:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.858388:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501612416 00000100:00100000:0.0:1789518164.858423:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501612416 00000100:00100000:0.0:1789518164.858559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:0.0:1789518164.858573:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7409e13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+15:10484:x1876445501612416:12345-192.168.202.43@tcp:35:rm.0 00000100:00100000:0.0:1789518164.858917:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7409e13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+16:10484:x1876445501612416:12345-192.168.202.43@tcp:35:rm.0 Request processed in 345us (7067us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789518164.858927:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789518164.863025:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518164.863247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501612672 00000100:00100000:3.0:1789518164.863263:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501612672 00000100:00100000:3.0:1789518164.863347:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:3.0:1789518164.863360:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+16:10484:x1876445501612672:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:3.0:1789518164.863397:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518164.863427:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dce000/0x8d0fd67942314449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856609d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.863630:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314450 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.863650:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314450 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.863663:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314450 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518164.863698:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789518164.864127:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dce000/0x8d0fd67942314449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856609d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.864153:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314450 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856609d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.864163:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:3.0:1789518164.864166:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518164.864170:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcfa00, rc 0) 00000100:00100000:3.0:1789518164.864248:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+18:10484:x1876445501612672:12345-192.168.202.43@tcp:101:rm.0 Request processed in 890us (1239us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789518164.864257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:3.0:1789518164.867447:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.871994:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501612800 00000100:00100000:2.0:1789518164.872020:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501612800 00000100:00100000:2.0:1789518164.872154:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:2.0:1789518164.872169:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:10484:x1876445501612800:12345-192.168.202.43@tcp:41:rm.0 00000004:00000024:2.0:1789518164.872251:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789518164.872417:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:10484:x1876445501612800:12345-192.168.202.43@tcp:41:rm.0 Request processed in 251us (4985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518164.872425:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:3.0:1789518164.878233:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.878386:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501612928 00000100:00100000:0.0:1789518164.878401:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501612928 00000100:00100000:0.0:1789518164.878519:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:0.0:1789518164.878532:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+18:10484:x1876445501612928:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:0.0:1789518164.878561:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518164.878606:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231445e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660a4 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878698:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878716:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878729:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878741:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878749:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878756:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878914:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942314473 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878924:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942314473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.878933:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942314473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518164.878976:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789518164.878982:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518164.879006:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942314473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879027:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942314473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879037:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879045:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879052:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879058:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518164.879064:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879072:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879086:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:0.0:1789518164.879089:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518164.879095:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879101:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314465 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879141:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879148:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879161:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879166:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518164.879169:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879176:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879185:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff8e73032eed00) 00010000:00010000:0.0:1789518164.879188:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518164.879191:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879197:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231446c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879231:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231445e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660a4 expref: 20 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879266:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942314473 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660a4 expref: 19 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.879274:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e743b22ea00) 00010000:00010000:0.0:1789518164.879276:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518164.879279:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166c400, rc 0) 00000100:00100000:0.0:1789518164.879357:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:10484:x1876445501612928:12345-192.168.202.43@tcp:101:rm.0 Request processed in 828us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.879373:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:3.0:1789518164.885210:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518164.885338:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501613184 00000100:00100000:2.0:1789518164.885352:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501613184 00000100:00100000:2.0:1789518164.885432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:2.0:1789518164.885444:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+19:10484:x1876445501613184:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:2.0:1789518164.885561:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518164.885600:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942314473 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660a4 expref: 19 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885629:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231441f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566088 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885651:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e743b22ea00) 00010000:00010000:2.0:1789518164.885663:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856608f expref: 17 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885673:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:2.0:1789518164.885695:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518164.885738:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885753:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885764:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885777:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885857:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.885865:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886034:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886044:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886052:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518164.886367:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789518164.886379:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332671914526ns, next at 333671911801ns, rc = 0 00010000:00010000:2.0:1789518164.886434:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886454:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886496:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886506:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886513:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886519:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886536:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518164.886560:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886566:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886573:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886580:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518164.886585:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886593:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886613:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e743b22ea00) 00010000:00010000:2.0:1789518164.886616:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789518164.886621:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886627:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314488 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886648:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886654:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886660:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886664:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518164.886666:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886672:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886679:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:2.0:1789518164.886681:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518164.886684:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886690:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd6794231447a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518164.886708:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2a86c9c reply state 00000000e2e0c540 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886720:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518164.886726:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff8e73032eed00) 00010000:00010000:2.0:1789518164.886728:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518164.886731:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518164.886901:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518164.886909:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.886916:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033acc00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518164.886919:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.886926:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.886936:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e743b22ea00) 00010000:00010000:3.0:1789518164.886946:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518164.886950:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.886956:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd6794231448f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518164.886969:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518164.886970:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518164.886972:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518164.888989:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:10484:x1876445501613184:12345-192.168.202.43@tcp:36:rm.0 Request processed in 3529us (3778us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789518164.889005:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:2.0:1789518164.895531:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.898044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501613440 00000100:00100000:0.0:1789518164.898067:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501613440 00000100:00100000:0.0:1789518164.898254:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:0.0:1789518164.898269:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+18:10484:x1876445501613440:12345-192.168.202.43@tcp:35:rm.0 00000100:00100000:0.0:1789518164.898659:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+19:10484:x1876445501613440:12345-192.168.202.43@tcp:35:rm.0 Request processed in 393us (3143us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789518164.898669:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:1.0:1789518164.906336:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518164.906547:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501613696 00000100:00100000:0.0:1789518164.906564:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501613696 00000100:00100000:0.0:1789518164.906671:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:0.0:1789518164.906687:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:10484:x1876445501613696:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:0.0:1789518164.906787:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789518164.906827:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314450 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856609d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.906861:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd679423143ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856607a expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.906873:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e743b22e700) 00010000:00010000:0.0:1789518164.906896:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423143af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856606c expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.906908:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:0.0:1789518164.906917:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518164.906980:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907001:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907014:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907029:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907036:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907042:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907193:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907202:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907209:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518164.907624:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789518164.907644:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907653:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907676:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907684:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166de00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518164.907690:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907700:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907711:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8e73032ee600) 00010000:00010000:0.0:1789518164.907715:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518164.907719:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907725:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166de00/0x8d0fd679423144a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907748:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907754:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907759:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907765:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166ca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518164.907767:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907784:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907794:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73032eec00) 00010000:00010000:0.0:1789518164.907796:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518164.907799:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907805:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942314496 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518164.907822:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046480fdd reply state 00000000a42c7a88 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907833:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518164.907839:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e73032ee900) 00010000:00010000:0.0:1789518164.907842:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518164.907845:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518164.907962:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+18:10484:x1876445501613696:12345-192.168.202.43@tcp:36:rm.0 Request processed in 1277us (1642us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789518164.907971:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:1.0:1789518164.984398:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518164.984431:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522669184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518164.984556:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518164.984993:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522669568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518164.985031:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518164.985055:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522670080:0@lo:400:kworker.0 00000100:00100000:3.0:1789518164.985081:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518164.985103:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522670592:0@lo:400:kworker.0 00000100:00100000:3.0:1789518164.985136:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518164.985156:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789518164.985161:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522669696:0@lo:400:kworker.0 00000100:00100000:0.0:1789518164.985276:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669184 00000100:00100000:0.0:1789518164.985291:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669184 00000100:00100000:0.0:1789518164.985367:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789518164.985378:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522669184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518164.985411:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518164.985512:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522669312:0@lo:400:kworker.0 00000100:00100000:1.0:1789518164.995045:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f90b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522669440:0@lo:400:kworker.0 00000100:00080000:0.0:1789518164.995307:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518164.995431:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522669184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10050us (10872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.995444:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789518164.995530:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670080 00000100:00100000:0.0:1789518164.995542:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670080 00000100:00100000:0.0:1789518164.995614:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670592 00000100:00100000:0.0:1789518164.995618:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670592 00000100:00100000:0.0:1789518164.995661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789518164.995672:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522670080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518164.995749:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522670080:12345-0@lo:400:kworker.0 Request processed in 80us (10667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.995757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789518164.995772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789518164.995779:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522670592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518164.995820:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522670592:12345-0@lo:400:kworker.0 Request processed in 41us (10682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.995826:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1789518164.995843:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518164.995847:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518164.996383:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669568 00000100:00100000:0.0:1789518164.996390:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669568 00000100:00100000:0.0:1789518164.996424:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789518164.996434:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522669568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518164.996512:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522669568:12345-0@lo:400:kworker.0 Request processed in 81us (11480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.996519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789518165.008063:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518165.008241:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522669824:0@lo:400:kworker.0 00000100:00100000:2.0:1789518165.008302:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518165.008337:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522670336:0@lo:400:kworker.0 00000100:00100000:2.0:1789518165.008367:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518165.008425:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669824 00000100:00100000:2.0:1789518165.008436:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669824 00000100:00100000:2.0:1789518165.008525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789518165.008538:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522669824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518165.008615:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522669824:12345-0@lo:400:kworker.0 Request processed in 79us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518165.008623:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789518165.008676:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670336 00000100:00100000:2.0:1789518165.008681:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670336 00000100:00100000:3.0:1789518165.011321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518165.011539:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669696 00000100:00100000:3.0:1789518165.011553:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669696 00000100:00100000:2.0:1789518165.011553:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789518165.011590:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522670336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.011728:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789518165.011739:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522669696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518165.011780:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522670336:12345-0@lo:400:kworker.0 Request processed in 133us (3337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518165.011793:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789518165.011853:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522669696:12345-0@lo:400:kworker.0 Request processed in 113us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518165.011861:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789518165.011899:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522669824:0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.011911:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522669696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.011926:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522670208:0@lo:400:kworker.0 00010000:00080000:2.0:1789518165.011933:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301966a00 x1876445522670336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518165.011961:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522670336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.011987:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518165.012083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670208 00000100:00100000:3.0:1789518165.012087:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670208 00000100:00100000:0.0:1789518165.019176:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669312 00000100:00100000:0.0:1789518165.019200:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669312 00000100:00100000:0.0:1789518165.019308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789518165.019321:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522669312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518165.019444:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522669312:12345-0@lo:400:kworker.0 Request processed in 127us (11392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518165.019452:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789518165.019530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518165.022850:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522669312:0@lo:400:kworker.0 00000100:00100000:0.0:1789518165.023110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522669952:0@lo:400:kworker.0 00000100:00100000:0.0:1789518165.023204:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518165.023368:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522670464:0@lo:400:kworker.0 00000100:00100000:0.0:1789518165.023410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518165.023412:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518165.023800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669440 00000100:00100000:3.0:1789518165.023810:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669440 00000100:00100000:3.0:1789518165.023866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670464 00000100:00100000:3.0:1789518165.023868:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670464 00000100:00100000:3.0:1789518165.023889:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789518165.023896:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522669440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.023978:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522669440:12345-0@lo:400:kworker.0 Request processed in 82us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518165.023982:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789518165.023994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789518165.024000:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522670464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.024027:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522670464:12345-0@lo:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518165.024033:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1789518165.024047:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518165.024073:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789518165.024080:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522670208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.024110:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522670208:12345-0@lo:400:kworker.0 Request processed in 32us (12126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518165.024126:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789518165.024170:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f90b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522669440:0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.024185:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522670464:0@lo:400:kworker.0 00010000:00080000:3.0:1789518165.024554:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301966300 x1876445522670208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518165.024563:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522670208:0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.024571:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522670720:0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.024598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518165.024616:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522669568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518165.024624:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522670080:0@lo:400:kworker.0 00010000:00080000:3.0:1789518165.024632:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301967100 x1876445522670592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518165.024638:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522670592:0@lo:400:kworker.0 00010000:00080000:3.0:1789518165.024647:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e6300 x1876445522669184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518165.024657:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522669184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518165.033722:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522669952 00000100:00100000:0.0:1789518165.033747:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522669952 00000100:00080000:3.0:1789518165.033852:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518165.033876:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670720 00000100:00100000:0.0:1789518165.033883:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670720 00000100:00080000:3.0:1789518165.033928:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518165.033936:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518165.033950:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522669952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518165.034089:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522669952:12345-0@lo:400:kworker.0 Request processed in 140us (10884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518165.034098:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518165.034131:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789518165.034140:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522670720:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789518165.034162:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301964000 x1876445522669952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518165.034182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301964000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522669952:0@lo:400:kworker.0 00000100:00100000:0.0:1789518165.034199:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522670720:12345-0@lo:400:kworker.0 Request processed in 59us (9598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518165.034207:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1789518165.034238:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301965c00 x1876445522670720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518165.034251:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522670720:0@lo:400:kworker.0 00010000:00010000:0.0:1789518165.045771:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518165.493747:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518165.493772:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522670848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518165.493851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518165.494079:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670848 00000100:00100000:3.0:1789518165.494095:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670848 00000100:00100000:3.0:1789518165.494156:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789518165.494166:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522670848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518165.494197:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518165.494249:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522670848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518165.494255:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1789518165.494332:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303780a80 x1876445522670848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518165.494350:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522670848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518166.007710:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522670976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518166.007841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518166.007965:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522670976 00000100:00100000:2.0:1789518166.007975:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522670976 00000100:00100000:2.0:1789518166.008037:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789518166.008046:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522670976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518166.008092:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518166.008159:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522670976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518166.008167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789518166.008227:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522670976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518166.008982:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522671104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518166.009043:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518166.009092:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518166.009100:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522671232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518166.009139:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518166.009178:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522671232 00000100:00100000:2.0:1789518166.009184:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522671232 00000100:00100000:2.0:1789518166.009219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789518166.009227:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522671232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518166.009255:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789518166.009295:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522671232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518166.009317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789518166.009359:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522671232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518166.009629:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522671104 00000100:00100000:0.0:1789518166.009635:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522671104 00000100:00100000:0.0:1789518166.009685:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789518166.009694:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522671104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518166.009719:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518166.009773:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522671104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518166.009785:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1789518166.014940:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303783800 x1876445522671104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518166.014978:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522671104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518166.069895:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518167.093654:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518168.117719:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518168.565905:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518168.565930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522671360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518168.566005:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518168.566131:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522671360 00000100:00100000:2.0:1789518168.566145:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522671360 00000100:00100000:2.0:1789518168.566327:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789518168.566340:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522671360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518168.566374:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518168.566426:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522671360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518168.566433:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1789518168.566499:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f908000 x1876445522671360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518168.566533:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522671360:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789518168.566640:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518168.991360:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518168.991394:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518168.991427:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518168.991455:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518168.991495:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518168.991520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518168.991567:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501613952 00000100:00100000:3.0:1789518168.991578:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501613952 00000100:00100000:3.0:1789518168.991635:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614464 00000100:00100000:3.0:1789518168.991639:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614464 00000100:00100000:3.0:1789518168.991654:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614080 00000100:00100000:3.0:1789518168.991657:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614080 00000100:00100000:3.0:1789518168.991669:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614336 00000100:00100000:3.0:1789518168.991671:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614336 00000100:00100000:3.0:1789518168.991687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 221 00000100:00100000:3.0:1789518168.991699:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+18:2387:x1876445501613952:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518168.991791:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+18:2387:x1876445501613952:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 93us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518168.991800:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 221 00000100:00100000:3.0:1789518168.991816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00100000:3.0:1789518168.991837:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501614464:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518168.991864:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501614464:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518168.991871:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00100000:3.0:1789518168.991885:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 223 00000100:00100000:3.0:1789518168.991891:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501614080:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518168.991913:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501614080:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518168.991921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 223 00000100:00100000:3.0:1789518168.991932:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 224 00000100:00100000:3.0:1789518168.991937:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501614336:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518168.991957:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501614336:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518168.991962:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 224 00000100:00100000:3.0:1789518168.991982:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501613824 00000100:00100000:3.0:1789518168.991985:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501613824 00000100:00100000:3.0:1789518168.992011:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 337 00000100:00100000:3.0:1789518168.992017:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501613824:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518168.992038:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501613824:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 22us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518168.992044:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 337 00000100:00100000:0.0:1789518168.993182:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614208 00000100:00100000:0.0:1789518168.993192:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614208 00000100:00100000:0.0:1789518168.993238:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:0.0:1789518168.993249:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501614208:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518168.993294:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501614208:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 48us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518168.993301:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00080000:0.0:1789518168.993327:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518168.993331:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518168.993334:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518169.144504:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518169.195683:0:13677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1789518170.102231:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522671488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518170.102306:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518170.103504:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518170.103520:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522671872:0@lo:400:kworker.0 00000100:00100000:2.0:1789518170.103576:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518170.103632:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522671488 00000100:00100000:2.0:1789518170.103641:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522671488 00000100:00100000:2.0:1789518170.103696:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789518170.103706:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522671488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518170.103738:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518170.103781:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522671488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518170.103789:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789518170.103812:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522671872 00000100:00100000:2.0:1789518170.103816:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522671872 00000100:00100000:2.0:1789518170.103840:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789518170.103846:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522671872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518170.103882:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522671872:12345-0@lo:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518170.103889:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789518170.103929:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522671872:0@lo:400:kworker.0 00010000:00080000:2.0:1789518170.103944:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033aad80 x1876445522671488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789518170.104225:0:9981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337889759969ns, next at 338889757039ns, rc = 0 00000100:00100000:2.0:1789518170.105516:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522671488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518170.111686:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522672384:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.111924:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.111962:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522672896:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.111981:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.111998:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789518170.112005:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522672000:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112027:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.112043:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522672512:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.112093:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522673024:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112111:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.112153:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672384 00000100:00100000:3.0:1789518170.112161:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672384 00000100:00100000:3.0:1789518170.112206:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672896 00000100:00100000:3.0:1789518170.112208:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672896 00000100:00100000:3.0:1789518170.112220:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672000 00000100:00100000:3.0:1789518170.112222:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672000 00000100:00100000:3.0:1789518170.112232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672512 00000100:00100000:3.0:1789518170.112234:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672512 00000100:00100000:3.0:1789518170.112251:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789518170.112257:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522672384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112301:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522672384:12345-0@lo:400:kworker.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.112305:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789518170.112317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789518170.112321:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522672896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112347:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522672896:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.112361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789518170.112374:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789518170.112380:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522672000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112402:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522672000:12345-0@lo:400:kworker.0 Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.112406:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789518170.112413:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789518170.112417:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522672512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112430:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522672512:12345-0@lo:400:kworker.0 Request processed in 13us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.112433:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789518170.112452:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522673024 00000100:00100000:3.0:1789518170.112454:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522673024 00000100:00100000:3.0:1789518170.112495:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789518170.112509:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522673024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.112530:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522673024:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.112534:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789518170.112985:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522671616:0@lo:400:kworker.0 00000100:00100000:0.0:1789518170.113027:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518170.113085:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522672128:0@lo:400:kworker.0 00000100:00100000:2.0:1789518170.113113:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522671616 00000100:00100000:0.0:1789518170.113114:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518170.113122:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522671616 00000100:00100000:3.0:1789518170.113155:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522672000:0@lo:400:kworker.0 00000100:00100000:2.0:1789518170.113164:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789518170.113173:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522671616:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789518170.113241:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f09180 x1876445522672512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518170.113252:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522672512:0@lo:400:kworker.0 00010000:00080000:3.0:1789518170.113263:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f08e00 x1876445522673024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518170.113282:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522673024:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.113294:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522672384:0@lo:400:kworker.0 00010000:00080000:3.0:1789518170.113303:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f09500 x1876445522672896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518170.113310:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522672896:0@lo:400:kworker.0 00000100:00100000:0.0:1789518170.113432:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522672640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.113448:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672128 00000100:00100000:3.0:1789518170.113454:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672128 00000100:00100000:3.0:1789518170.113506:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789518170.113513:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522672128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.113558:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522672128:12345-0@lo:400:kworker.0 Request processed in 45us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.113564:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789518170.114540:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.114593:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672640 00000100:00100000:3.0:1789518170.114599:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672640 00000100:00100000:0.0:1789518170.114608:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522672128:0@lo:400:kworker.0 00000100:00100000:0.0:1789518170.114638:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789518170.114643:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518170.114650:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522671744:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.114654:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522672640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.114702:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522672640:12345-0@lo:400:kworker.0 Request processed in 53us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.114708:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789518170.115304:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522671616:12345-0@lo:400:kworker.0 Request processed in 2130us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518170.115314:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789518170.115410:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518170.115443:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522672256:0@lo:400:kworker.0 00000100:00100000:0.0:1789518170.115502:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.115505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522671744 00000100:00100000:3.0:1789518170.115513:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522671744 00000100:00100000:0.0:1789518170.115526:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522672768:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.115553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789518170.115554:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.115567:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522671744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518170.115588:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522671616:0@lo:400:kworker.0 00010000:00080000:0.0:1789518170.115605:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f09f80 x1876445522672640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518170.115617:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522672640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.115618:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522671744:12345-0@lo:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.115640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789518170.115645:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522671744:0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.115657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672768 00000100:00100000:3.0:1789518170.115662:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672768 00000100:00100000:3.0:1789518170.115690:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789518170.115696:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522672768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518170.115772:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522672256 00000100:00100000:2.0:1789518170.115777:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522672256 00000100:00100000:2.0:1789518170.115815:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789518170.115822:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522672256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518170.118778:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522672768:12345-0@lo:400:kworker.0 Request processed in 3072us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.118794:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1789518170.118799:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518170.118806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518170.118810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518170.118814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789518170.120120:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789518170.120139:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789518170.121980:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518170.122006:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522673152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789518170.122124:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518170.122187:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522673152 00000100:00100000:0.0:1789518170.122196:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522673152 00000100:00100000:0.0:1789518170.122246:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518170.122269:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522673152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789518170.122309:0:9982:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1789518170.122562:0:9982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa9e154, atime: 0x6aa9e154, ctime: 0x6aa9e154, blocks: 0x0 00010000:00010000:0.0:1789518170.122571:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.122588:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1789518170.122594:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518170.122601:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.122620:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.122630:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.122638:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.122656:0:9982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518170.122953:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522673152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 684us (828us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789518170.122972:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789518170.123000:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518170.123006:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.123015:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166c400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518170.123021:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.123031:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.123050:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.123059:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edaccc12/0x8d0fd679423144ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.123090:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518170.123092:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518170.123094:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789518170.123125:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7435f09c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789518170.123130:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522673152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789518170.123426:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522672256:12345-0@lo:400:kworker.0 Request processed in 7602us (7921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518170.123437:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1789518170.123570:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f08380 x1876445522672256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518170.123585:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522672256:0@lo:400:kworker.0 00010000:00010000:3.0:1789518170.123658:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123669:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123676:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123682:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518170.123686:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123692:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123705:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff8e73032eed00) 00010000:00010000:3.0:1789518170.123708:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518170.123712:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123718:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314403 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123756:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123763:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123769:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123775:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518170.123777:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123783:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123791:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8e743b22ea00) 00010000:00010000:3.0:1789518170.123793:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518170.123796:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123802:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf800/0x8d0fd67942314418 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123823:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123829:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123835:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123846:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518170.123850:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123856:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123864:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff8e73032eed00) 00010000:00010000:3.0:1789518170.123867:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518170.123870:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123876:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314481 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123893:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123899:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123905:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123910:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518170.123913:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123918:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123937:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e73032ee900) 00010000:00010000:3.0:1789518170.123940:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518170.123943:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.123949:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd6794231449d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518170.124642:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522672768:0@lo:400:kworker.0 00010000:00010000:2.0:1789518170.167339:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518170.227356:0:13725:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7ac3f0c0 20000000:00000080:1.0:1789518170.227373:0:13725:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e73033ed000 uarg=0000000000000000 20000000:01000000:1.0:1789518170.227412:0:13725:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789518170.227420:0:13725:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789518170.227430:0:13725:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789518170.228018:0:13726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789518170.228161:0:13725:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789518170.232080:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789518170.232118:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789518170.232134:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789518170.232160:0:13725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789518170.232180:0:13725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232201:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232210:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231433f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232217:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231434d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232225:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231435b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232232:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942314369 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232259:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232266:0:13725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232307:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232323:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 12 pid: 6505 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.232338:0:13725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673280:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518170.232513:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942314369 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232523:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942314369 expref: 23 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.232532:0:13725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673408:0@lo:104: 00000100:00100000:3.0:1789518170.232573:0:13725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518170.232608:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd6794231435b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232617:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd6794231435b expref: 23 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.232625:0:13725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673536:0@lo:104: 00000100:00100000:3.0:1789518170.232654:0:13725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518170.232695:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd6794231434d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232704:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd6794231434d expref: 23 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.232712:0:13725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673664:0@lo:104: 00000100:00100000:3.0:1789518170.232802:0:13725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.232834:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522673408 00000100:00100000:3.0:1789518170.232841:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522673408 00000100:00100000:3.0:1789518170.232874:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522673536 00000100:00100000:3.0:1789518170.232877:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522673536 00000100:00100000:3.0:1789518170.232886:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522673664 00000100:00100000:3.0:1789518170.232888:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522673664 00000100:00100000:3.0:1789518170.232899:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518170.232907:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:13725:x1876445522673408:12345-0@lo:104: 00010000:00010000:3.0:1789518170.232920:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.232966:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518170.232972:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+5:13725:x1876445522673408:12345-0@lo:104: Request processed in 66us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.232979:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518170.232994:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789518170.233000:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:13725:x1876445522673536:12345-0@lo:104: 00010000:00010000:3.0:1789518170.233007:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233048:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789518170.233053:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+4:13725:x1876445522673536:12345-0@lo:104: Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.233059:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789518170.233109:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518170.233116:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:13725:x1876445522673664:12345-0@lo:104: 00010000:00010000:3.0:1789518170.233123:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233156:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789518170.233162:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:13725:x1876445522673664:12345-0@lo:104: Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.233168:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1789518170.233185:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789518170.233191:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233199:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518170.233203:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233211:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518170.233219:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518170.233225:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518170.233256:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233263:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518170.233278:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233285:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400031800/0x8d0fd67942314369 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314370 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233300:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518170.233303:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233308:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9dc00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518170.233311:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233318:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518170.233325:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518170.233329:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518170.233341:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233346:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518170.233362:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233379:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9dc00/0x8d0fd6794231435b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314362 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233399:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518170.233404:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233409:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518170.233412:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233418:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518170.233424:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518170.233428:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518170.233440:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233445:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518170.233451:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233456:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e73033ac200/0x8d0fd6794231434d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314354 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233488:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.233495:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.233497:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518170.233511:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522673920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518170.233540:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.233560:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518170.233566:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522674048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518170.233584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518170.233617:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd6794231433f expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.233626:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd6794231433f expref: 23 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.233634:0:13725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522674176:0@lo:104: 00000100:00100000:3.0:1789518170.233658:0:13725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.233677:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522674176 00000100:00100000:3.0:1789518170.233681:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522674176 00000100:00100000:3.0:1789518170.233700:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789518170.233706:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:13725:x1876445522674176:12345-0@lo:104: 00010000:00010000:3.0:1789518170.233714:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518170.233929:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518170.233939:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522673792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518170.234004:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518170.234019:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522673920 00000100:00100000:0.0:1789518170.234023:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522673920 00010000:00010000:0.0:1789518170.234051:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231435b expref: 24 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518170.234081:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522674048 00000100:00100000:0.0:1789518170.234085:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522674048 00010000:00010000:0.0:1789518170.234097:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231434d expref: 25 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518170.234113:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518170.234119:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3637:x1876445522673920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518170.234129:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518170.234135:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231435b expref: 25 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.234143:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd6794231435b expref: 25 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.234157:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518170.234553:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518170.234585:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522673792 00000100:00100000:1.0:1789518170.234589:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522673792 00010000:00010000:1.0:1789518170.234604:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314369 expref: 26 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518170.234619:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518170.234625:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+26:3637:x1876445522674048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518170.234632:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518170.234637:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231434d expref: 26 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.234644:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd6794231434d expref: 26 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.234654:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518170.234690:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+26:3637:x1876445522674048:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.234697:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518170.234714:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789518170.234719:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3639:x1876445522673792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518170.234726:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518170.234742:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942314369 expref: 25 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.234760:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942314369 expref: 25 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.234769:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518170.234798:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3639:x1876445522673792:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.234804:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789518170.234836:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522674048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518170.234858:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522673792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518170.235991:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522673920:12345-0@lo:103:ldlm_bl.0 Request processed in 1868us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518170.236001:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1789518170.236999:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518170.237011:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+3:13725:x1876445522674176:12345-0@lo:104: Request processed in 3302us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.237020:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:3.0:1789518170.237046:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518170.237053:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.237086:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033aca00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518170.237091:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.237100:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518170.237107:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518170.237113:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518170.237152:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.237159:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518170.237176:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.237182:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e73033aca00/0x8d0fd6794231433f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942314346 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.237197:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.237199:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.237201:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.237493:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.237507:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.237531:0:13725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522674432:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518170.237591:0:13725:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73035b1180 going to sleep for 11 seconds 00010000:00010000:3.0:1789518170.237615:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9d200/0x8d0fd67942314370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942314369 expref: 23 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.237638:0:13725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673408:0@lo:104: 00010000:00010000:3.0:1789518170.237649:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0c000/0x8d0fd67942314362 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd6794231435b expref: 22 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.237656:0:13725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673536:0@lo:104: 00010000:00010000:3.0:1789518170.237827:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e73033adc00/0x8d0fd67942314354 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd6794231434d expref: 21 pid: 6506 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.237837:0:13725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673664:0@lo:104: 00010000:00010000:2.0:1789518170.238341:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518170.238427:0:13725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522674176:0@lo:104: 00000100:00100000:0.0:1789518170.238528:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518170.238619:0:13725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522673280:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518170.238660:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518170.238683:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522674304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518170.238715:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518170.238856:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522673920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518170.239014:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614592 00000100:00100000:2.0:1789518170.239020:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614592 00010000:00010000:2.0:1789518170.239050:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 13 pid: 6505 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518170.239127:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522674304 00000100:00100000:2.0:1789518170.239131:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522674304 00010000:00010000:2.0:1789518170.239144:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231433f expref: 21 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518170.239196:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:1.0:1789518170.239205:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501614592:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518170.239219:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518170.239225:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 13 pid: 6505 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.239235:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 13 pid: 6505 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.239250:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400031600/0x8d0fd67942314377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856605e expref: 13 pid: 6505 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.239263:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518170.239308:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:395607ea-c3c4-4708-8905-dac70dffbbe5+12:2388:x1876445501614592:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 104us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.239324:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:1.0:1789518170.239342:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789518170.239348:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3640:x1876445522674304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518170.239356:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518170.239361:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231433f expref: 21 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.239371:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd6794231433f expref: 21 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.239381:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e73033ac400/0x8d0fd67942314346 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd6794231433f expref: 21 pid: 6507 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.239390:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518170.239421:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3640:x1876445522674304:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.239427:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518170.240021:0:13725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1876445522674432:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518170.240058:0:13725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518170.240142:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522674304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518170.240929:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518170.240991:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614720 00000100:00100000:1.0:1789518170.240997:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614720 00010000:00010000:1.0:1789518170.241021:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518170.241051:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:1.0:1789518170.241058:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:2388:x1876445501614720:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518170.241094:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518170.241100:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241120:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241133:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9ce00/0x8d0fd67942314338 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566057 expref: 12 pid: 6506 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241151:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241160:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241176:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241184:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241191:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241198:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241205:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518170.241210:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241220:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241245:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.241256:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518170.241295:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:395607ea-c3c4-4708-8905-dac70dffbbe5+11:2388:x1876445501614720:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 237us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.241304:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00010000:00010000:3.0:1789518170.241436:0:13725:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.241445:0:13725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.241461:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518170.614324:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522674560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518170.614389:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.614498:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522674560 00000100:00100000:3.0:1789518170.614506:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522674560 00000100:00100000:3.0:1789518170.614550:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789518170.614559:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522674560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518170.614580:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518170.614625:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522674560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.614632:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789518170.614728:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522674560:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1789518170.879276:0:13774:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb96fab10 20000000:00000080:3.0:1789518170.879300:0:13774:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e73033ed400 uarg=0000000000000000 20000000:01000000:3.0:1789518170.879350:0:13774:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789518170.879358:0:13774:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789518170.879366:0:13774:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789518170.880231:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789518170.880406:0:13774:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789518170.880650:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789518170.880694:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789518170.880711:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789518170.880854:0:13774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789518170.880881:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880899:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880910:0:13774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880928:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880935:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880943:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880949:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dce000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518170.880953:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880961:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880973:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880981:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.880987:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144b9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518171.125728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522674688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518171.125735:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522674816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518171.125895:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518171.125911:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522674944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518171.126433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.126510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.126589:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522674816 00000100:00100000:1.0:1789518171.126601:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522674816 00000100:00100000:1.0:1789518171.126664:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522674944 00000100:00100000:1.0:1789518171.126667:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522674944 00000100:00100000:1.0:1789518171.126684:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789518171.126693:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522674816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518171.126732:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518171.126781:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522674816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518171.126789:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789518171.126805:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789518171.126812:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522674944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518171.126845:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518171.126875:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522674944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518171.126881:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789518171.126923:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522674816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518171.126988:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522674944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518171.127292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518171.127399:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522674688 00000100:00100000:2.0:1789518171.127405:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522674688 00000100:00100000:2.0:1789518171.127446:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789518171.127456:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522674688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518171.127570:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518171.127616:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522674688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518171.127623:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1789518171.127711:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303545500 x1876445522674688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518171.127729:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522674688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789518171.189738:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789518171.381590:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518171.381599:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e730205a000 from 7 10000000:01000000:1.0:1789518171.381604:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518171.381670:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518171.381684:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518171.381696:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518171.381733:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518171.381806:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.381885:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.382116:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675072 00000100:00100000:0.0:1789518171.382126:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675072 00000100:00100000:0.0:1789518171.382178:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789518171.382188:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:6509:x1876445522675072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518171.382203:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518171.382217:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e740166c400/0x8d0fd679423144c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423144c0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.382240:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e740166c400/0x8d0fd679423144c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423144c0 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.382253:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e740166c400/0x8d0fd679423144c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423144c0 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.382262:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166c400, rc 0) 00000100:00100000:0.0:1789518171.382309:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522675072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.382315:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789518171.382575:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518171.382590:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518171.382600:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518171.382679:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518171.382723:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.382762:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518171.382818:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675200 00000100:00100000:2.0:1789518171.382823:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675200 00000100:00100000:2.0:1789518171.382857:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789518171.382864:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522675200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518171.382979:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522675200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518171.382986:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789518171.383280:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518171.383307:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518171.383344:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.383366:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029eff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518171.383426:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675328 00000100:00100000:3.0:1789518171.383432:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675328 00000100:00100000:3.0:1789518171.383502:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789518171.383511:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522675328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518171.383598:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522675328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518171.383604:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789518171.383784:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518171.384345:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13788:1876445522675456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518171.384387:0:13788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.384483:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.384544:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675456 00000100:00100000:0.0:1789518171.384550:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675456 00000100:00100000:0.0:1789518171.384587:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789518171.384596:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:13788:x1876445522675456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518171.384752:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:13788:x1876445522675456:12345-0@lo:502:llog_process_th.0 Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.384767:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789518171.385003:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13788:1876445522675456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518171.385109:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518171.385120:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.385123:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518171.385132:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e730205a000 00000020:00000080:1.0:1789518171.385135:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518171.385246:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518171.385251:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.385252:0:13788:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518171.385256:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518171.385259:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.385260:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789518171.385264:0:13788:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e730205a000 00000020:00000080:1.0:1789518171.385266:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789518171.389387:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13788:1876445522675584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518171.389481:0:13788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.389533:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.389791:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675584 00000100:00100000:0.0:1789518171.389800:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675584 00000100:00100000:0.0:1789518171.389856:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789518171.389866:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:13788:x1876445522675584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518171.389986:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:13788:x1876445522675584:12345-0@lo:502:llog_process_th.0 Request processed in 121us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.389994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789518171.390214:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13788:1876445522675584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518171.390242:0:13788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518171.390250:0:13788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.390253:0:13788:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789518171.390261:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789518171.390431:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789518171.390450:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518171.390460:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.390509:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518171.390521:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518171.390524:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7435dc1800 from 7 10000000:01000000:0.0:1789518171.390526:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518171.390557:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.390566:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.390576:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518171.390592:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.390635:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.390762:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675712 00000100:00100000:1.0:1789518171.390768:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675712 00000100:00100000:1.0:1789518171.390800:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789518171.390807:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:6509:x1876445522675712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518171.390816:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518171.390828:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423144d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423144ce expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518171.390849:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423144d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423144ce expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518171.390860:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423144d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423144ce expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518171.390868:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0da00, rc 0) 00000100:00100000:1.0:1789518171.390897:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522675712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518171.390904:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789518171.391008:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.391035:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518171.391050:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.391070:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518171.391122:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.391148:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.391170:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.391189:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675840 00000100:00100000:0.0:1789518171.391193:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675840 00000100:00100000:0.0:1789518171.391214:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789518171.391221:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522675840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.391330:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522675840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.391337:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789518171.391368:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.391392:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.391429:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.391442:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.391453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522675968 00000100:00100000:0.0:1789518171.391456:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522675968 00000100:00100000:0.0:1789518171.391499:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789518171.391512:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522675968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.391578:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522675968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.391584:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789518171.391622:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522675968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518171.394819:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13790:1876445522676096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518171.394901:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.394944:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029ef300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.395630:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676096 00000100:00100000:0.0:1789518171.395638:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676096 00000100:00100000:0.0:1789518171.395825:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789518171.395836:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:13790:x1876445522676096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518171.395970:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:13790:x1876445522676096:12345-0@lo:502:llog_process_th.0 Request processed in 135us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.395978:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789518171.396134:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13790:1876445522676096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518171.396165:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518171.396174:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.396177:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518171.396183:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7435dc1800 00000020:00000080:3.0:1789518171.396186:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518171.396247:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518171.396251:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.396252:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518171.396255:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518171.396258:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.396259:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789518171.396263:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7435dc1800 00000020:00000080:3.0:1789518171.396265:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518171.396305:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13790:1876445522676224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518171.396342:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518171.396366:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73035b1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518171.396448:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676224 00000100:00100000:1.0:1789518171.396459:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676224 00000100:00100000:1.0:1789518171.396515:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789518171.396521:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:13790:x1876445522676224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518171.396591:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:13790:x1876445522676224:12345-0@lo:502:llog_process_th.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518171.396598:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789518171.396833:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13790:1876445522676224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518171.396853:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518171.396858:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.396859:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789518171.396863:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789518171.397103:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789518171.397126:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518171.397135:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.397146:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518171.397157:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518171.397159:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e74044cd800 from 7 10000000:01000000:0.0:1789518171.397163:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518171.397189:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.397197:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.397217:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518171.397234:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.397265:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.397294:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.397314:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676352 00000100:00100000:0.0:1789518171.397317:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676352 00000100:00100000:0.0:1789518171.397338:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789518171.397344:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:6509:x1876445522676352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518171.397352:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518171.397365:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e740166de00/0x8d0fd679423144e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423144dc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.397387:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e740166de00/0x8d0fd679423144e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423144dc expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.397397:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e740166de00/0x8d0fd679423144e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423144dc expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.397406:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166de00, rc 0) 00000100:00100000:0.0:1789518171.397437:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522676352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.397443:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789518171.397503:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518171.397516:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.397531:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518171.397578:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.397603:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.397616:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.397629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676480 00000100:00100000:0.0:1789518171.397632:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676480 00000100:00100000:0.0:1789518171.397647:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789518171.399886:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522676480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.400244:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522676480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 374us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.400253:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789518171.405486:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518171.405559:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518171.405644:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518171.405829:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73035b1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.405892:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676608 00000100:00100000:0.0:1789518171.405900:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676608 00000100:00100000:0.0:1789518171.405955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789518171.405964:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522676608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.406093:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522676608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.406102:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789518171.406250:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518171.406696:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13793:1876445522676736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518171.406870:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518171.406914:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73035b1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518171.406961:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676736 00000100:00100000:0.0:1789518171.406967:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676736 00000100:00100000:0.0:1789518171.407004:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789518171.407012:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:13793:x1876445522676736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518171.407235:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:13793:x1876445522676736:12345-0@lo:502:llog_process_th.0 Request processed in 223us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518171.407249:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789518171.407329:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13793:1876445522676736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518171.407352:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518171.407363:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.407365:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518171.407373:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e74044cd800 00000020:00000080:3.0:1789518171.407376:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518171.407459:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518171.407489:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.407491:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518171.407494:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518171.407496:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.407498:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789518171.407501:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e74044cd800 00000020:00000080:3.0:1789518171.407503:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518171.407536:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13793:1876445522676864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518171.407568:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518171.407587:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676864 00000100:00100000:3.0:1789518171.407591:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676864 00000100:00100000:3.0:1789518171.407615:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789518171.407620:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:13793:x1876445522676864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518171.408179:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:13793:x1876445522676864:12345-0@lo:502:llog_process_th.0 Request processed in 556us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518171.408194:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789518171.408237:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73035b1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518171.408253:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13793:1876445522676864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518171.408275:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518171.408280:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518171.408281:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789518171.408285:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789518171.409325:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789518171.409357:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518171.409369:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.409382:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518171.409395:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518171.409398:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7439644800 from 7 10000000:01000000:0.0:1789518171.409401:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518171.409444:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.409453:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.409484:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518171.409510:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.409570:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.409606:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518171.409905:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522676992 00000100:00100000:3.0:1789518171.409913:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522676992 00000100:00100000:3.0:1789518171.409961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789518171.409970:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:6509:x1876445522676992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518171.409984:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518171.409996:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423144ea expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518171.410029:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423144ea expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518171.410040:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423144ea expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518171.410049:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dce000, rc 0) 00000100:00100000:3.0:1789518171.410095:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522676992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518171.410102:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789518171.410294:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522676992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518171.410309:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.410319:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518171.410384:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522677120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.410408:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.410436:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518171.410531:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522677120 00000100:00100000:2.0:1789518171.410535:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522677120 00000100:00100000:2.0:1789518171.410564:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789518171.410570:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522677120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518171.410670:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522677120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518171.410677:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789518171.410862:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522677120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.410890:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522677248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518171.410927:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518171.410951:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518171.412202:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522677248 00000100:00100000:2.0:1789518171.412211:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522677248 00000100:00100000:2.0:1789518171.412261:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789518171.412269:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522677248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518171.412389:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:6509:x1876445522677248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518171.412397:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000040:00080000:2.0:1789518171.413185:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789518171.414446:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfb1fc7-85a9-4c59-b070-db791c081ea7:6509:1876445522677248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518171.415986:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301967100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13794:1876445522677376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518171.416096:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518171.416145:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406dadcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518171.416256:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522677376 00000100:00100000:3.0:1789518171.416265:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522677376 00000100:00100000:3.0:1789518171.416322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789518171.416339:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:13794:x1876445522677376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518171.416506:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:13794:x1876445522677376:12345-0@lo:502:llog_process_th.0 Request processed in 168us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518171.416513:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789518171.416633:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301967100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13794:1876445522677376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518171.416671:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518171.416681:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.416683:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518171.416693:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7439644800 00000020:00000080:1.0:1789518171.416695:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518171.416821:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518171.416825:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.416827:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518171.416831:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518171.416834:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.416835:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789518171.416839:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7439644800 00000020:00000080:1.0:1789518171.416841:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789518171.416877:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13794:1876445522677504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518171.416912:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518171.416937:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029eff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518171.417681:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522677504 00000100:00100000:3.0:1789518171.417689:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522677504 00000100:00100000:3.0:1789518171.417846:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789518171.417856:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:13794:x1876445522677504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518171.417964:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:13794:x1876445522677504:12345-0@lo:502:llog_process_th.0 Request processed in 110us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518171.417971:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789518171.418094:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfb1fc7-85a9-4c59-b070-db791c081ea7:13794:1876445522677504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518171.418120:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518171.418126:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518171.418128:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789518171.418134:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789518171.418203:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789518171.418225:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518171.418234:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518171.418245:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518171.431880:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789518172.054492:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518172.056016:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614848 00000100:00100000:3.0:1789518172.056030:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614848 00000100:00100000:3.0:1789518172.056110:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 359 00000100:00100000:3.0:1789518172.056120:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+11:6162:x1876445501614848:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518172.056141:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518172.056162:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660ab expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518172.056194:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ab expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518172.056205:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ab expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518172.056215:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf800, rc 0) 00000100:00100000:3.0:1789518172.056293:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501614848:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518172.056319:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 359 00000100:00100000:1.0:1789518172.066710:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518172.066975:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501614976 00000100:00100000:2.0:1789518172.066985:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501614976 00000100:00100000:2.0:1789518172.067043:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 360 00000100:00100000:2.0:1789518172.067063:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501614976:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518172.067213:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501614976:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 160us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518172.067220:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 360 00000100:00100000:2.0:1789518172.071772:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518172.072003:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501615104 00000100:00100000:1.0:1789518172.072014:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501615104 00000100:00100000:1.0:1789518172.072084:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 361 00000100:00100000:1.0:1789518172.072095:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501615104:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518172.072257:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501615104:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 163us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518172.072264:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 361 00000100:00100000:1.0:1789518172.081392:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518172.081524:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501615232 00000100:00100000:3.0:1789518172.081535:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501615232 00000100:00100000:3.0:1789518172.081588:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 362 00000100:00100000:3.0:1789518172.081597:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:10770:x1876445501615232:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518172.081776:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:10770:x1876445501615232:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518172.081784:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 362 00000100:00100000:3.0:1789518172.088600:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518172.088790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501615360 00000100:00100000:2.0:1789518172.088806:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501615360 00000100:00100000:3.0:1789518172.089082:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 363 00000100:00100000:3.0:1789518172.089094:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:10770:x1876445501615360:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518172.089269:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:10770:x1876445501615360:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 177us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518172.089277:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 363 00000100:00100000:2.0:1789518172.101642:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518172.101849:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501615488 00000100:00100000:1.0:1789518172.101859:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501615488 00000100:00100000:1.0:1789518172.101924:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 364 00000100:00100000:1.0:1789518172.101935:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+12:6162:x1876445501615488:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518172.101952:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518172.101970:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d200/0x8d0fd679423144ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660b2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518172.102001:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d200/0x8d0fd679423144ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660b2 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518172.102028:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0d200/0x8d0fd679423144ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660b2 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518172.102037:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d200, rc 0) 00000100:00100000:1.0:1789518172.102118:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501615488:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 185us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518172.102125:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 364 00000100:00100000:1.0:1789518172.108450:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518172.108582:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501615616 00000100:00100000:2.0:1789518172.108593:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501615616 00000100:00100000:2.0:1789518172.108769:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 365 00000100:00100000:2.0:1789518172.108779:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501615616:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518172.108951:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501615616:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 173us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518172.108972:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 365 00000100:00100000:0.0:1789518172.111712:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518172.119445:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501615744 00000100:00100000:1.0:1789518172.119461:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501615744 00000100:00100000:1.0:1789518172.119651:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 366 00000100:00100000:1.0:1789518172.119662:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501615744:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518172.119951:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:6162:x1876445501615744:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 290us (8253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518172.119959:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 366 00000100:00100000:0.0:1789518172.131214:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518172.131493:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501615872 00000100:00100000:1.0:1789518172.131503:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501615872 00000100:00100000:1.0:1789518172.131556:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 367 00000100:00100000:1.0:1789518172.131565:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:10773:x1876445501615872:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518172.131710:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:10773:x1876445501615872:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 145us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518172.131724:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 367 00000100:00100000:0.0:1789518172.140597:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518172.140668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616000 00000100:00100000:3.0:1789518172.140680:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616000 00000100:00100000:3.0:1789518172.140745:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 368 00000100:00100000:3.0:1789518172.140756:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:10773:x1876445501616000:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518172.141489:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:10773:x1876445501616000:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 709us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518172.141499:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 368 00010000:00010000:3.0:1789518172.214544:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518172.472787:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789518172.474372:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789518173.238911:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518173.685776:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518173.685803:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522677632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518173.685902:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518173.685959:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522677632 00000100:00100000:2.0:1789518173.685969:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522677632 00000100:00100000:2.0:1789518173.686050:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789518173.686054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518173.686061:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522677632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518173.686094:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518173.686161:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522677632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518173.686169:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1789518173.686198:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301965500 x1876445522677632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518173.686221:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522677632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518174.100890:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518174.100943:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518174.101046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616128 00000100:00100000:2.0:1789518174.101058:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616128 00000100:00100000:3.0:1789518174.101071:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616256 00000100:00100000:3.0:1789518174.101079:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616256 00000100:00100000:2.0:1789518174.101124:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 369 00000100:00100000:2.0:1789518174.101136:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501616128:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518174.101144:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:3.0:1789518174.101155:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501616256:12345-192.168.202.43@tcp:400:kworker.0 00000100:00080000:0.0:1789518174.101240:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518174.101654:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501616128:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 518us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518174.101663:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 369 00000100:00100000:3.0:1789518174.102010:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501616256:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 856us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518174.102019:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:2.0:1789518174.102084:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518174.102355:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616384 00000100:00100000:3.0:1789518174.102361:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616384 00000100:00100000:3.0:1789518174.102418:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 232 00000100:00100000:3.0:1789518174.102425:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501616384:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518174.102488:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501616384:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 63us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518174.102495:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 232 00000100:00100000:2.0:1789518174.102732:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518174.102793:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616512 00000100:00100000:3.0:1789518174.102798:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616512 00000100:00100000:3.0:1789518174.102842:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:3.0:1789518174.102849:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501616512:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518174.102880:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501616512:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518174.102887:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00080000:0.0:1789518174.103691:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518174.103709:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518174.104100:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518174.104151:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518174.104782:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616768 00000100:00100000:0.0:1789518174.104792:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616768 00000100:00100000:0.0:1789518174.104857:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616640 00000100:00100000:0.0:1789518174.104860:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616640 00000100:00100000:0.0:1789518174.104884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:0.0:1789518174.104895:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501616768:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518174.104960:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501616768:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 67us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518174.104978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:0.0:1789518174.104996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 234 00000100:00100000:0.0:1789518174.105002:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501616640:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518174.105027:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501616640:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518174.105107:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 234 00000100:00080000:3.0:1789518174.105115:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518174.105121:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789518174.261708:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518175.222978:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518175.223005:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522677760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518175.223107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518175.223171:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522677760 00000100:00100000:2.0:1789518175.223181:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522677760 00000100:00100000:2.0:1789518175.223304:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518175.223316:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522677760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518175.223349:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518175.223402:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522677760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518175.223427:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1789518175.223493:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518175.223605:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522677760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518175.223759:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522678272:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.223789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.223815:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522678784:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.223838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.223859:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522679296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.223881:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.223899:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789518175.223905:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522677888:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.223929:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.223945:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522678400:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.223964:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.223979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522678912:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.224054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678400 00000100:00100000:1.0:1789518175.224060:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678400 00000100:00100000:0.0:1789518175.224064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678272 00000100:00100000:0.0:1789518175.224072:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678272 00000100:00100000:1.0:1789518175.224095:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789518175.224105:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522678400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.224119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678784 00000100:00100000:0.0:1789518175.224123:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678784 00000100:00100000:1.0:1789518175.224151:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522678400:12345-0@lo:400:kworker.0 Request processed in 47us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518175.224160:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789518175.224161:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789518175.224172:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522678272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224196:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789518175.224207:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522678784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.224217:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522678272:12345-0@lo:400:kworker.0 Request processed in 49us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518175.224225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789518175.224246:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522678784:12345-0@lo:400:kworker.0 Request processed in 41us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518175.224252:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789518175.224273:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522678144:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224286:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522678400:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224301:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522678272:0@lo:400:kworker.0 00010000:00080000:1.0:1789518175.224316:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f71880 x1876445522678784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518175.224316:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.224328:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522678784:0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.224345:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522678656:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224367:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678144 00000100:00100000:1.0:1789518175.224372:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678144 00000100:00100000:0.0:1789518175.224374:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518175.224397:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522679168:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224403:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789518175.224413:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522678144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.224424:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.224456:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522678144:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518175.224488:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522678144:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224489:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789518175.224506:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789518175.224523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678656 00000100:00100000:0.0:1789518175.224523:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522678016:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224530:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678656 00000100:00100000:0.0:1789518175.224557:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.224559:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679168 00000100:00100000:1.0:1789518175.224563:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679168 00000100:00100000:1.0:1789518175.224583:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678016 00000100:00100000:0.0:1789518175.224584:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522678528:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224588:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678016 00000100:00100000:1.0:1789518175.224608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789518175.224618:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522678656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.224620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518175.224645:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522679040:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224658:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522678656:12345-0@lo:400:kworker.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518175.224676:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789518175.224679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518175.224692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679040 00000100:00100000:1.0:1789518175.224696:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679040 00000100:00100000:0.0:1789518175.224708:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522678656:0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224714:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789518175.224722:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522679168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.224738:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789518175.224748:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522678016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.224759:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522679168:12345-0@lo:400:kworker.0 Request processed in 37us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518175.224765:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789518175.224778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789518175.224784:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522679040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518175.224854:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679296 00000100:00100000:3.0:1789518175.224858:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679296 00000100:00100000:3.0:1789518175.224883:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678912 00000100:00100000:3.0:1789518175.224885:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678912 00000100:00100000:3.0:1789518175.224894:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522678528 00000100:00100000:3.0:1789518175.224896:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522678528 00000100:00100000:3.0:1789518175.224906:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789518175.224911:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522679296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518175.225059:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518175.225067:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522678912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.229496:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522678016:12345-0@lo:400:kworker.0 Request processed in 4738us (4927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518175.229512:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789518175.229526:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522679040:12345-0@lo:400:kworker.0 Request processed in 4739us (4850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518175.229536:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789518175.229609:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522678016:0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.229623:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522679040:0@lo:400:kworker.0 00010000:00080000:0.0:1789518175.229637:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e74317c3800 x1876445522679168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518175.229647:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522679168:0@lo:400:kworker.0 00000100:00080000:0.0:1789518175.229702:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518175.229708:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518175.229711:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518175.229714:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518175.229722:0:8427:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518175.229735:0:8427:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789518175.229737:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522677888 00000100:00100000:0.0:1789518175.229745:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522677888 00000100:00100000:0.0:1789518175.229823:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789518175.229836:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522677888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.229857:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789518175.229869:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522678528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518175.229929:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522678528:12345-0@lo:400:kworker.0 Request processed in 62us (5312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518175.229937:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518175.229942:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dc93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522677888:12345-0@lo:400:kworker.0 Request processed in 109us (6010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518175.229951:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789518175.230000:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522677888:0@lo:400:kworker.0 00010000:00080000:0.0:1789518175.230040:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f72d80 x1876445522678528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518175.230051:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522678528:0@lo:400:kworker.0 00000100:00100000:3.0:1789518175.230309:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522679296:12345-0@lo:400:kworker.0 Request processed in 5395us (6425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518175.230318:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789518175.230387:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522678912:12345-0@lo:400:kworker.0 Request processed in 5319us (6372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518175.230395:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1789518175.233983:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f73100 x1876445522678912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518175.234005:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522678912:0@lo:400:kworker.0 00000100:00100000:0.0:1789518175.234033:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522679296:0@lo:400:kworker.0 00010000:00010000:3.0:1789518175.285945:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518175.733872:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522679424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518175.733961:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518175.734215:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679424 00000100:00100000:3.0:1789518175.734224:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679424 00000100:00100000:3.0:1789518175.734280:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518175.734290:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522679424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518175.734316:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518175.734373:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522679424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518175.734380:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518175.734573:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522679424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518176.245942:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522679552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518176.246077:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518176.246269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679552 00000100:00100000:2.0:1789518176.246278:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679552 00000100:00100000:2.0:1789518176.246335:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789518176.246346:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522679552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518176.246380:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518176.246441:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522679552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518176.246448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789518176.246519:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522679552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518176.247245:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518176.247257:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522679680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518176.247297:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518176.248570:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679680 00000100:00100000:3.0:1789518176.248588:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679680 00000100:00100000:3.0:1789518176.248666:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789518176.248696:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522679680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518176.248739:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518176.248851:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522679680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518176.248860:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1789518176.249087:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303545c00 x1876445522679680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518176.249114:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522679680:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789518176.249723:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000004:00080000:0.0:1789518176.251064:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789518176.253814:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522679808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518176.253924:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518176.256459:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679808 00000100:00100000:1.0:1789518176.256492:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679808 00000100:00100000:1.0:1789518176.256663:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789518176.256687:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522679808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518176.256743:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518176.256864:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522679808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518176.256891:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789518176.257004:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522679808:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789518176.313079:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518177.338336:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518178.357822:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518178.807383:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518178.807411:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522679936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518178.807529:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518178.807775:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522679936 00000100:00100000:2.0:1789518178.807786:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522679936 00000100:00100000:2.0:1789518178.807852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789518178.807862:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522679936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518178.807894:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518178.807948:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522679936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518178.807974:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1789518178.808078:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789518178.808133:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301965180 x1876445522679936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518178.808155:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522679936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518179.229662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518179.229765:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518179.229816:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518179.229835:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518179.229863:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518179.229907:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518179.229948:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617152 00000100:00100000:3.0:1789518179.229960:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617152 00000100:00100000:3.0:1789518179.230035:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617408 00000100:00100000:3.0:1789518179.230038:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617408 00000100:00100000:3.0:1789518179.230064:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617024 00000100:00100000:3.0:1789518179.230067:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617024 00000100:00100000:3.0:1789518179.230091:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617536 00000100:00100000:3.0:1789518179.230094:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617536 00000100:00100000:3.0:1789518179.230113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 241 00000100:00100000:3.0:1789518179.230124:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501617152:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518179.230226:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501617152:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 103us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518179.230235:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 241 00000100:00100000:3.0:1789518179.230253:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 242 00000100:00100000:3.0:1789518179.230259:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501617408:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518179.230315:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501617408:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518179.230323:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 242 00000100:00100000:3.0:1789518179.230336:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 243 00000100:00100000:3.0:1789518179.230344:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501617024:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518179.230368:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501617024:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518179.230374:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 243 00000100:00100000:3.0:1789518179.230385:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 244 00000100:00100000:3.0:1789518179.230391:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501617536:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518179.230415:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501617536:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518179.230421:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 244 00000100:00080000:3.0:1789518179.230610:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518179.230615:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518179.231861:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617280 00000100:00100000:1.0:1789518179.231878:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617280 00000100:00100000:1.0:1789518179.231966:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 103 00000100:00100000:1.0:1789518179.231978:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501617280:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518179.232228:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501617280:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 253us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518179.232236:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 103 00000100:00080000:3.0:1789518179.232997:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518179.233205:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501616896 00000100:00100000:2.0:1789518179.233214:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501616896 00000100:00100000:2.0:1789518179.233264:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 371 00000100:00100000:2.0:1789518179.233273:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501616896:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518179.233703:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501616896:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 430us (4052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518179.233712:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 371 00010000:00010000:2.0:1789518179.383345:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518180.342075:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522680064:0@lo:400:kworker.0 00000100:00100000:2.0:1789518180.342187:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518180.342400:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680064 00000100:00100000:1.0:1789518180.342411:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680064 00000100:00100000:1.0:1789518180.342500:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789518180.342512:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522680064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.342909:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518180.342923:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522680320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518180.342987:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.343031:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680320 00000100:00100000:3.0:1789518180.343036:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680320 00000100:00100000:3.0:1789518180.343091:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518180.343101:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522680320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518180.343133:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518180.343176:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522680320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.343202:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1789518180.343226:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518180.343257:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789518180.343264:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7435f09c00, transno 4294967301 00000100:00100000:3.0:1789518180.343284:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522680320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518180.343331:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522680192:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.343363:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.343398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680192 00000100:00100000:3.0:1789518180.343402:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680192 00000100:00100000:3.0:1789518180.343436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789518180.343443:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522680192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.343503:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522680192:12345-0@lo:400:kworker.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.343509:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789518180.343540:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522680192:0@lo:400:kworker.0 00000100:00100000:1.0:1789518180.344099:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522680064:12345-0@lo:400:kworker.0 Request processed in 1585us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518180.344108:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789518180.344622:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522680704:0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.344673:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518180.344701:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522681216:0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.344727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518180.344749:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789518180.344755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522680576:0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.344781:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518180.344796:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522681088:0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.344817:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518180.344832:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522681600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.344851:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518180.344883:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680704 00000100:00100000:0.0:1789518180.344891:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680704 00000100:00100000:0.0:1789518180.344935:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789518180.344943:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522680704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.345007:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522680704:12345-0@lo:400:kworker.0 Request processed in 64us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518180.345014:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789518180.345039:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681216 00000100:00100000:0.0:1789518180.345043:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681216 00000100:00100000:3.0:1789518180.345170:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522680448:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.345205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.345225:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522680960:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.345249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.345267:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522681472:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.345290:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.345309:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789518180.345314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522680832:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.345339:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.345379:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522681344:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.345403:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.345425:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680576 00000100:00100000:3.0:1789518180.345429:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680576 00000100:00100000:3.0:1789518180.345452:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681088 00000100:00100000:3.0:1789518180.345455:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681088 00000100:00100000:1.0:1789518180.345530:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681600 00000100:00100000:1.0:1789518180.345534:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681600 00000100:00100000:0.0:1789518180.345611:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680832 00000100:00100000:0.0:1789518180.345615:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680832 00000100:00100000:2.0:1789518180.345686:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522680064:0@lo:400:kworker.0 00000100:00100000:2.0:1789518180.345723:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789518180.345731:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522681216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518180.345773:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522681216:12345-0@lo:400:kworker.0 Request processed in 43us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518180.345780:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789518180.345833:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680960 00000100:00100000:2.0:1789518180.345838:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680960 00000100:00100000:3.0:1789518180.345912:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681472 00000100:00100000:3.0:1789518180.345916:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681472 00000100:00100000:3.0:1789518180.345932:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681344 00000100:00100000:3.0:1789518180.345934:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681344 00000100:00100000:3.0:1789518180.345949:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789518180.345955:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522680576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346003:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522680576:12345-0@lo:400:kworker.0 Request processed in 48us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.346010:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789518180.346022:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789518180.346029:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522681088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346058:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522681088:12345-0@lo:400:kworker.0 Request processed in 30us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.346076:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789518180.346087:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789518180.346094:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522681472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346128:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522681472:12345-0@lo:400:kworker.0 Request processed in 34us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.346135:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789518180.346147:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789518180.346153:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522681344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346195:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522681344:12345-0@lo:400:kworker.0 Request processed in 43us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.346202:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789518180.346234:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522681344:0@lo:400:kworker.0 00010000:00080000:3.0:1789518180.346249:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f20e00 x1876445522681472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518180.346260:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522681472:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346309:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522680448 00000100:00100000:3.0:1789518180.346313:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522680448 00000100:00100000:3.0:1789518180.346347:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789518180.346353:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522680448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346393:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522680448:12345-0@lo:400:kworker.0 Request processed in 40us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.346399:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789518180.346432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522680448:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346506:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522680576:0@lo:400:kworker.0 00010000:00080000:3.0:1789518180.346518:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302ab9c00 x1876445522681088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518180.346529:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522681088:0@lo:400:kworker.0 00000100:00100000:3.0:1789518180.346541:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522680704:0@lo:400:kworker.0 00010000:00080000:3.0:1789518180.346553:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302abb100 x1876445522681216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518180.346562:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522681216:0@lo:400:kworker.0 00000100:00080000:3.0:1789518180.346607:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518180.346613:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518180.346616:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518180.346619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518180.347124:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789518180.347136:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522681600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518180.347202:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522681600:12345-0@lo:400:kworker.0 Request processed in 69us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518180.347209:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789518180.347249:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522681600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.347381:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518180.347392:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522680832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518180.347448:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522680832:12345-0@lo:400:kworker.0 Request processed in 58us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518180.347455:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1789518180.347504:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e90a80 x1876445522680832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518180.347516:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522680832:0@lo:400:kworker.0 00000100:00100000:2.0:1789518180.347777:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789518180.347787:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522680960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518180.347838:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522680960:12345-0@lo:400:kworker.0 Request processed in 53us (2588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518180.347845:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789518180.347927:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522680960:0@lo:400:kworker.0 00010000:00010000:0.0:1789518180.406016:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518180.854167:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518180.854202:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522681728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518180.854313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518180.854494:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681728 00000100:00100000:3.0:1789518180.854506:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681728 00000100:00100000:3.0:1789518180.854581:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789518180.854604:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522681728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518180.854641:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518180.854706:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522681728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518180.854714:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789518180.855201:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522681728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518181.368313:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522681856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518181.368406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518181.368494:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518181.368502:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522681984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518181.368529:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518181.368579:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681856 00000100:00100000:0.0:1789518181.368588:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681856 00000100:00100000:0.0:1789518181.368649:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789518181.368659:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522681856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518181.368703:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518181.368760:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522681856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518181.368767:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789518181.368795:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522681984 00000100:00100000:0.0:1789518181.368799:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522681984 00000100:00100000:0.0:1789518181.368829:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518181.368837:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522681984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518181.368860:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518181.368892:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522681984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518181.368911:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1789518181.369169:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73036dd880 x1876445522681984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518181.369192:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522681984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518181.369208:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522681856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518181.370307:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522682112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518181.370363:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518181.370413:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522682112 00000100:00100000:0.0:1789518181.370421:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522682112 00000100:00100000:0.0:1789518181.370459:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789518181.370486:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522682112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518181.370519:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789518181.370565:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522682112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518181.370572:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789518181.370614:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522682112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789518181.432556:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518182.453921:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518182.710279:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789518182.711522:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789518183.481010:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518183.926819:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518183.926859:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7301965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522682240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518183.926979:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518183.928433:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522682240 00000100:00100000:3.0:1789518183.928542:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522682240 00000100:00080000:0.0:1789518183.928714:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518183.928768:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789518183.928795:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522682240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518183.928845:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518183.928979:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522682240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518183.928988:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1789518183.929082:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7301965500 x1876445522682240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518183.929109:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7301965500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522682240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518184.341002:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518184.341080:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518184.341171:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518184.341336:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617664 00000100:00100000:2.0:1789518184.341350:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617664 00000100:00100000:2.0:1789518184.341417:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 373 00000100:00100000:2.0:1789518184.341428:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2390:x1876445501617664:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518184.341564:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2390:x1876445501617664:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 138us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518184.341572:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 373 00000100:00100000:3.0:1789518184.342030:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617792 00000100:00100000:3.0:1789518184.342036:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617792 00000100:00100000:1.0:1789518184.342150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501617920 00000100:00100000:3.0:1789518184.342155:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 251 00000100:00100000:1.0:1789518184.342158:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501617920 00000100:00100000:3.0:1789518184.342168:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501617792:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518184.342967:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501617792:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 797us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518184.342995:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 251 00000100:00080000:0.0:1789518184.346010:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518184.346024:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518184.346933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 252 00000100:00100000:1.0:1789518184.346966:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501617920:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518184.347162:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501617920:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 205us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518184.347172:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 252 00000100:00100000:2.0:1789518184.380689:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518184.380733:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518184.380777:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518184.380914:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618048 00000100:00100000:3.0:1789518184.380923:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618048 00000100:00100000:3.0:1789518184.380996:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:3.0:1789518184.381004:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2386:x1876445501618048:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:3.0:1789518184.381032:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314426 00000100:00080000:3.0:1789518184.381041:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8e7303554800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518184.381081:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1789518184.381221:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+2:2386:x1876445501618048:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 217us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518184.381227:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:1.0:1789518184.381649:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618304 00000100:00100000:1.0:1789518184.381665:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618304 00000100:00100000:1.0:1789518184.381739:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618176 00000100:00100000:1.0:1789518184.381745:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618176 00000100:00100000:1.0:1789518184.381785:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 253 00000100:00100000:1.0:1789518184.381800:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501618304:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518184.381814:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 254 00000100:00100000:3.0:1789518184.381827:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501618176:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518184.381892:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501618304:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 96us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518184.381901:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 253 00010000:00010000:0.0:1789518184.382034:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518184.382199:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518184.382204:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518184.382207:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518184.382414:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501618176:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 588us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518184.382424:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 254 00010000:00010000:2.0:1789518184.502412:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518185.462118:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518185.462156:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522682368:0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.462224:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518185.462252:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518185.462336:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518185.462347:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522682880:0@lo:400:kworker.0 00000100:00100000:2.0:1789518185.462385:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518185.462457:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522682368 00000100:00100000:2.0:1789518185.462459:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522682624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.462502:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522682368 00000100:00100000:2.0:1789518185.462561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518185.462591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789518185.462607:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518185.462619:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522682752:0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.462622:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522682368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518185.462657:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518185.462751:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522682368:12345-0@lo:400:kworker.0 Request processed in 134us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.462767:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789518185.462830:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522683008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518185.462884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518185.462945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522682368:0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.462983:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683008 00000100:00100000:3.0:1789518185.462987:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683008 00000100:00100000:3.0:1789518185.464954:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789518185.464988:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522683008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518185.465237:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518185.465639:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522683008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 667us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.465649:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789518185.465697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518185.465764:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522683008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518185.466870:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522682880 00000100:00100000:3.0:1789518185.466885:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522682880 00000100:00100000:3.0:1789518185.466965:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522682624 00000100:00100000:3.0:1789518185.466970:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522682624 00000100:00100000:3.0:1789518185.467002:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789518185.467014:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522682880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.468193:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522682880:12345-0@lo:400:kworker.0 Request processed in 1172us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.468210:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789518185.469816:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789518185.469848:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522682624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.469974:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522682624:12345-0@lo:400:kworker.0 Request processed in 143us (7413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.469982:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789518185.470108:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522682880:0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.470185:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522682624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.470248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522682752 00000100:00100000:3.0:1789518185.471834:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522682752 00000100:00100000:3.0:1789518185.471948:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789518185.471962:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522682752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.472575:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522682752:12345-0@lo:400:kworker.0 Request processed in 614us (9915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.472585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789518185.472754:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522682752:0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.472982:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522682496:0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.473064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518185.473624:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522683136:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.473685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518185.473726:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683136 00000100:00100000:1.0:1789518185.473744:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683136 00000100:00100000:1.0:1789518185.473808:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789518185.473818:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522683136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.473868:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522683136:12345-0@lo:400:kworker.0 Request processed in 52us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518185.473875:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1789518185.473898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789518185.473940:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f71f80 x1876445522683136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518185.473954:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522683136:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.473993:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522683264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.474027:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518185.474302:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522682496 00000100:00100000:1.0:1789518185.474307:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522682496 00000100:00100000:1.0:1789518185.474491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683264 00000100:00100000:1.0:1789518185.474495:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683264 00000100:00100000:1.0:1789518185.474525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789518185.474532:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522682496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.474569:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522682496:12345-0@lo:400:kworker.0 Request processed in 38us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518185.474575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789518185.474797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789518185.474808:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522683264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.475002:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522682496:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.475669:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522683264:12345-0@lo:400:kworker.0 Request processed in 860us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518185.475699:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1789518185.475730:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518185.475832:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522683264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.475899:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518185.475911:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522683392:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.475972:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518185.476627:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683392 00000100:00100000:3.0:1789518185.476636:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683392 00000100:00100000:3.0:1789518185.476705:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789518185.476716:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522683392:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789518185.482513:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789518185.482540:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518185.482576:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522683520:0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.482819:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518185.483139:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683520 00000100:00100000:2.0:1789518185.483150:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683520 00000100:00100000:2.0:1789518185.483242:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518185.483264:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522683520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518185.483658:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522683520:12345-0@lo:400:kworker.0 Request processed in 340us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518185.483669:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1789518185.483832:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518185.483892:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e5500 x1876445522683520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518185.483909:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522683520:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.484973:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522683648:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.485234:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518185.485680:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522683776:0@lo:400:kworker.0 00000100:00100000:1.0:1789518185.485718:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518185.485865:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522683392:12345-0@lo:400:kworker.0 Request processed in 9140us (9881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.485879:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:0.0:1789518185.485995:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f71f80 x1876445522683392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518185.486024:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522683392:0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.486232:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518185.486240:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522683904:0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.486302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518185.486696:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683904 00000100:00100000:0.0:1789518185.486707:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683904 00000100:00100000:0.0:1789518185.486867:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789518185.486885:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522683904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518185.487587:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522683904:12345-0@lo:400:kworker.0 Request processed in 708us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518185.487676:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1789518185.487712:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518185.489979:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522683904:0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.491589:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683648 00000100:00100000:3.0:1789518185.491675:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683648 00000100:00100000:3.0:1789518185.491768:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522683776 00000100:00100000:3.0:1789518185.491773:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522683776 00000100:00100000:3.0:1789518185.491798:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789518185.491809:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522683648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.491941:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522683648:12345-0@lo:400:kworker.0 Request processed in 134us (6707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.491949:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789518185.491987:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789518185.491994:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522683776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518185.492181:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522683776:12345-0@lo:400:kworker.0 Request processed in 186us (6461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518185.492189:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:1.0:1789518185.492696:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73031e6300 x1876445522683776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518185.492727:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522683776:0@lo:400:kworker.0 00000100:00080000:0.0:1789518185.493244:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518185.493262:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518185.493306:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522683648:0@lo:400:kworker.0 00010000:00010000:0.0:1789518185.526359:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518185.974539:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518185.974575:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522684032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518185.974873:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518185.975353:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684032 00000100:00100000:2.0:1789518185.975367:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684032 00000100:00100000:2.0:1789518185.975502:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518185.975515:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522684032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518185.975548:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518185.975636:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522684032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518185.975645:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789518185.976180:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522684032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518186.489551:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522684160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518186.489701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518186.489908:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522684288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518186.489957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518186.490181:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684288 00000100:00100000:1.0:1789518186.490192:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684288 00000100:00100000:1.0:1789518186.490254:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789518186.490265:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522684288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518186.490316:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518186.490379:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522684288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518186.490398:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789518186.490451:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522684288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518186.490532:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684160 00000100:00100000:2.0:1789518186.490536:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684160 00000100:00100000:2.0:1789518186.490569:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789518186.490575:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522684160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518186.490594:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518186.490621:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522684160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518186.490626:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1789518186.490695:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73036dd880 x1876445522684160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518186.490709:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522684160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518186.491621:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522684416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518186.491666:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518186.491783:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684416 00000100:00100000:0.0:1789518186.491789:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684416 00000100:00100000:0.0:1789518186.491823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789518186.491829:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522684416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518186.491851:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789518186.493039:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522684416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1201us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518186.493051:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789518186.493258:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522684416:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789518186.550887:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518187.573999:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518188.597968:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518189.047435:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518189.047516:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522684544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518189.047623:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518189.047777:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684544 00000100:00100000:2.0:1789518189.047788:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684544 00000100:00100000:2.0:1789518189.047867:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789518189.047881:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522684544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518189.047936:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518189.047993:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522684544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518189.048001:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1789518189.048597:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f882d80 x1876445522684544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789518189.054667:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518189.058786:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522684544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518189.459280:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518189.459360:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618432 00000100:00100000:0.0:1789518189.459375:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618432 00000100:00100000:0.0:1789518189.459519:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 375 00000100:00100000:0.0:1789518189.459532:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501618432:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518189.459646:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501618432:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 108us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518189.459656:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 375 00000100:00100000:3.0:1789518189.460152:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518189.460194:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518189.460223:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518189.460260:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518189.460310:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618560 00000100:00100000:1.0:1789518189.460319:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618560 00000100:00100000:1.0:1789518189.460376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618688 00000100:00100000:1.0:1789518189.460379:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618688 00000100:00100000:1.0:1789518189.460395:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618816 00000100:00100000:1.0:1789518189.460398:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618816 00000100:00100000:1.0:1789518189.460411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501618944 00000100:00100000:1.0:1789518189.460425:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501618944 00000100:00100000:1.0:1789518189.460445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 261 00000100:00100000:1.0:1789518189.460454:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501618560:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518189.460543:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501618560:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 90us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518189.460551:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 261 00000100:00100000:1.0:1789518189.460569:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 262 00000100:00100000:1.0:1789518189.460575:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501618688:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518189.460600:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501618688:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518189.460606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 262 00000100:00100000:1.0:1789518189.460617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 263 00000100:00100000:1.0:1789518189.460623:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501618816:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518189.460687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 264 00000100:00100000:2.0:1789518189.460701:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501618944:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518189.460736:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501618944:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 40us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518189.460742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 264 00000100:00100000:1.0:1789518189.460902:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501618816:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 278us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518189.460909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 263 00000100:00080000:3.0:1789518189.463422:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518189.465184:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789518189.622863:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789518190.080526:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:2.0:1789518190.080541:0:9506:0:(genops.c:885:class_export_put()) final put ffff8e7303551800/5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:3.0:1789518190.080933:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7303551800/5499dd84-083f-4a57-a16b-aad857025063 for lustre-OST0001 00000020:00000080:3.0:1789518190.081018:0:473:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7303554800 for lustre-OST0001 00000100:00100000:0.0:1789518190.582196:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522684672:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.582318:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518190.582386:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522685184:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.582414:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518190.582432:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522685696:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.582453:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518190.582496:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522686208:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.582517:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518190.582555:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789518190.582562:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522684800:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.582587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518190.582608:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522685312:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.582627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518190.582642:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522685824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.582661:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518190.582697:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685696 00000100:00100000:0.0:1789518190.582707:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685696 00000100:00100000:0.0:1789518190.582769:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686208 00000100:00100000:0.0:1789518190.582773:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686208 00000100:00100000:0.0:1789518190.582799:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685312 00000100:00100000:0.0:1789518190.582801:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685312 00000100:00100000:0.0:1789518190.582818:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789518190.582826:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522685696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.583162:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684672 00000100:00100000:2.0:1789518190.583168:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684672 00000100:00100000:2.0:1789518190.583205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789518190.583213:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522684672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.583274:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522684672:12345-0@lo:400:kworker.0 Request processed in 49us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518190.583290:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789518190.583336:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518190.583344:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522686208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.583376:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522686208:12345-0@lo:400:kworker.0 Request processed in 33us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518190.583395:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518190.583413:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789518190.583420:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522685312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.583449:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522685312:12345-0@lo:400:kworker.0 Request processed in 30us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518190.583455:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789518190.583533:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684800 00000100:00100000:2.0:1789518190.583538:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684800 00000100:00100000:2.0:1789518190.583713:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685824 00000100:00100000:2.0:1789518190.583718:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685824 00000100:00100000:2.0:1789518190.583746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789518190.583753:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522684800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.583790:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522684800:12345-0@lo:400:kworker.0 Request processed in 39us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518190.583797:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789518190.583810:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789518190.583817:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522685824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.583846:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522685824:12345-0@lo:400:kworker.0 Request processed in 30us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518190.583852:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789518190.584017:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522684800:0@lo:400:kworker.0 00010000:00080000:2.0:1789518190.584035:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880e00 x1876445522685312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518190.584046:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522685312:0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.584057:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522685824:0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.584079:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522684672:0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.584091:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522686208:0@lo:400:kworker.0 00000100:00100000:0.0:1789518190.584603:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522685696:12345-0@lo:400:kworker.0 Request processed in 1773us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518190.584612:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789518190.584793:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518190.584800:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518190.584803:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518190.584822:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522684928:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.584902:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518190.584933:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522685440:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.584960:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518190.584979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522685952:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585001:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518190.585026:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789518190.585034:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522685056:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585056:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518190.585072:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522685568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585093:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518190.585105:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522686080:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585128:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518190.585161:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685184 00000100:00100000:3.0:1789518190.585168:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685184 00000100:00100000:3.0:1789518190.585204:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522684928 00000100:00100000:3.0:1789518190.585207:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522684928 00000100:00100000:3.0:1789518190.585222:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789518190.585229:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522685184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585290:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522685184:12345-0@lo:400:kworker.0 Request processed in 61us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.585297:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789518190.585312:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789518190.585318:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522684928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585351:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522684928:12345-0@lo:400:kworker.0 Request processed in 33us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.585357:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789518190.585402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685440 00000100:00100000:3.0:1789518190.585406:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685440 00000100:00100000:3.0:1789518190.585436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685952 00000100:00100000:3.0:1789518190.585439:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685952 00000100:00100000:3.0:1789518190.585454:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685056 00000100:00100000:3.0:1789518190.585456:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685056 00000100:00100000:3.0:1789518190.585493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522685568 00000100:00100000:3.0:1789518190.585496:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522685568 00000100:00100000:3.0:1789518190.585511:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789518190.585518:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522685440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585577:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522685440:12345-0@lo:400:kworker.0 Request processed in 60us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.585584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789518190.585597:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789518190.585603:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522685952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585632:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522685952:12345-0@lo:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.585638:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789518190.585649:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789518190.585656:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522685056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585683:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522685056:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.585689:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789518190.585701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789518190.585707:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522685568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585733:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522685568:12345-0@lo:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.585750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1789518190.585766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518190.585770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518190.585781:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686080 00000100:00100000:3.0:1789518190.585784:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686080 00000100:00100000:3.0:1789518190.585816:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789518190.585823:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522686080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585854:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522686080:12345-0@lo:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.585860:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789518190.585889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518190.585924:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522685056:0@lo:400:kworker.0 00010000:00080000:3.0:1789518190.585940:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f883100 x1876445522685568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518190.585952:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522685568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585961:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522686080:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585971:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522684928:0@lo:400:kworker.0 00000100:00100000:3.0:1789518190.585981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522685440:0@lo:400:kworker.0 00010000:00080000:3.0:1789518190.585992:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880a80 x1876445522685952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518190.586001:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522685952:0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.587071:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522685184:0@lo:400:kworker.0 00010000:00080000:2.0:1789518190.587092:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881500 x1876445522685696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518190.587102:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522685696:0@lo:400:kworker.0 00000100:00100000:2.0:1789518190.587482:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518190.587498:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522686336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518190.587585:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518190.587863:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686336 00000100:00100000:3.0:1789518190.587957:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686336 00000100:00100000:3.0:1789518190.588043:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789518190.588054:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522686336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518190.588094:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518190.588159:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522686336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518190.588168:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789518190.588516:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522686336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789518190.649170:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518191.097723:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518191.097751:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522686464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518191.097846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518191.097890:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686464 00000100:00100000:1.0:1789518191.097902:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686464 00000100:00100000:1.0:1789518191.097976:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789518191.097989:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522686464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518191.098019:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518191.098076:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522686464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518191.098084:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789518191.098641:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522686464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518191.607556:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522686592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518191.607663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518191.607755:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522686720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518191.607784:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518191.607825:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686592 00000100:00100000:1.0:1789518191.607836:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686592 00000100:00100000:1.0:1789518191.607905:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686720 00000100:00100000:1.0:1789518191.607909:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686720 00000100:00100000:1.0:1789518191.607929:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789518191.607940:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522686592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518191.607991:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518191.608045:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522686592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518191.608054:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789518191.608075:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789518191.608091:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522686720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518191.608114:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789518191.608150:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522686720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518191.608157:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789518191.608210:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522686720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518191.608242:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522686592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518191.614007:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522686848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518191.614110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518191.618219:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686848 00000100:00100000:0.0:1789518191.618241:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686848 00000100:00100000:3.0:1789518191.618527:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789518191.618542:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522686848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518191.618595:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518191.618711:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522686848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (4602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518191.618720:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1789518191.620134:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97f100 x1876445522686848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518191.620165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522686848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518191.673981:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518192.694386:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518192.950104:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789518192.954178:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789518193.719691:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518194.167083:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518194.167117:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522686976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518194.167229:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518194.167491:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522686976 00000100:00100000:2.0:1789518194.167505:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522686976 00000100:00100000:2.0:1789518194.167603:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518194.167614:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522686976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518194.167652:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518194.167713:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522686976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518194.167722:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1789518194.167771:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e74079d3b80 x1876445522686976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518194.167807:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522686976:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789518194.168013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518194.591750:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518194.591787:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518194.591817:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518194.591850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518194.591877:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518194.591922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619328 00000100:00100000:2.0:1789518194.591934:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619328 00000100:00100000:2.0:1789518194.592001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619584 00000100:00100000:2.0:1789518194.592004:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619584 00000100:00100000:2.0:1789518194.592017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619200 00000100:00100000:2.0:1789518194.592020:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619200 00000100:00100000:2.0:1789518194.592032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619456 00000100:00100000:2.0:1789518194.592034:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619456 00000100:00100000:2.0:1789518194.592053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 271 00000100:00100000:2.0:1789518194.592063:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501619328:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518194.592205:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 272 00000100:00100000:3.0:1789518194.592217:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501619584:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518194.592311:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501619584:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 97us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518194.592320:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 272 00000100:00100000:3.0:1789518194.592345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 273 00000100:00100000:3.0:1789518194.592352:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501619200:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518194.592400:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501619200:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 49us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518194.592407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 273 00000100:00100000:3.0:1789518194.592420:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 274 00000100:00100000:3.0:1789518194.592426:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501619456:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518194.592446:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501619456:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518194.592452:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 274 00000100:00080000:3.0:1789518194.592692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518194.592697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518194.593369:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501619328:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 1301us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518194.593380:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 271 00000100:00100000:1.0:1789518194.593534:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619072 00000100:00100000:1.0:1789518194.593544:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619072 00000100:00100000:1.0:1789518194.593589:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 377 00000100:00100000:1.0:1789518194.593598:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501619072:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518194.593632:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501619072:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 36us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518194.593639:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 377 00010000:00010000:3.0:1789518194.742067:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518195.703092:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518195.703136:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522687104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518195.703233:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518195.703408:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522687232:0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.703452:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518195.705154:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522687232 00000100:00100000:2.0:1789518195.705174:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522687232 00000100:00100000:2.0:1789518195.705253:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789518195.705265:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522687232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.705358:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522687232:12345-0@lo:400:kworker.0 Request processed in 95us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518195.705366:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789518195.705425:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522687104 00000100:00100000:2.0:1789518195.705487:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522687104 00000100:00100000:3.0:1789518195.705853:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522687360:0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.705905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518195.706869:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522687360 00000100:00100000:3.0:1789518195.706879:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522687360 00000100:00100000:2.0:1789518195.707167:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789518195.707181:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522687104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518195.707218:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518195.707301:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522687104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518195.707308:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1789518195.707339:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518195.707388:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522687104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518195.707427:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522687232:0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.707517:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789518195.707528:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522687360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.707578:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522687360:12345-0@lo:400:kworker.0 Request processed in 53us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518195.707585:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789518195.707650:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522687360:0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.712232:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522687616:0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.712407:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518195.712457:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522688128:0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.713077:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522687616 00000100:00100000:3.0:1789518195.713091:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522687616 00000100:00100000:2.0:1789518195.713426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522687872:0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.713808:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518195.713882:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522688640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.714017:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688128 00000100:00100000:3.0:1789518195.714024:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688128 00000100:00100000:0.0:1789518195.714212:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789518195.714227:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522688128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.714400:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789518195.714408:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522687616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.714795:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518195.715209:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522688128:12345-0@lo:400:kworker.0 Request processed in 983us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518195.715217:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789518195.715414:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522688384:0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.715453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518195.715624:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522687744:0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.715676:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518195.715701:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522688256:0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.715724:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518195.715759:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522687744 00000100:00100000:1.0:1789518195.715767:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522687744 00000100:00100000:1.0:1789518195.715803:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789518195.715810:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522687744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.715874:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522687744:12345-0@lo:400:kworker.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518195.715881:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789518195.715909:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522687488:0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.715945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518195.715964:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522688000:0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.715994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522687488 00000100:00100000:1.0:1789518195.715997:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522687488 00000100:00100000:1.0:1789518195.716021:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789518195.716027:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522687488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518195.716065:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522687488:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518195.716071:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789518195.716335:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522687744:0@lo:400:kworker.0 00000100:00100000:0.0:1789518195.717213:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688384 00000100:00100000:0.0:1789518195.717222:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688384 00000100:00100000:3.0:1789518195.717858:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522687616:12345-0@lo:400:kworker.0 Request processed in 3444us (5445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518195.717871:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789518195.717908:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518195.717968:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522687616:0@lo:400:kworker.0 00010000:00080000:3.0:1789518195.717985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97fb80 x1876445522688128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518195.717996:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522688128:0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.718028:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522687872 00000100:00100000:3.0:1789518195.718033:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522687872 00000100:00100000:3.0:1789518195.718075:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688256 00000100:00100000:3.0:1789518195.718078:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688256 00000100:00100000:3.0:1789518195.718094:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688640 00000100:00100000:3.0:1789518195.718096:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688640 00000100:00100000:3.0:1789518195.718125:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789518195.718133:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522687872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.718204:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522687872:12345-0@lo:400:kworker.0 Request processed in 72us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518195.718209:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789518195.718219:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789518195.718224:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522688256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.718264:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522688256:12345-0@lo:400:kworker.0 Request processed in 40us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518195.718270:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789518195.718294:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789518195.718298:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522688640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518195.718330:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522688640:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518195.718335:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1789518195.718694:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518195.718701:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518195.718704:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518195.718721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518195.718760:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522688512:0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.718799:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518195.718845:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522687488:0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.718871:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688000 00000100:00100000:2.0:1789518195.718875:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688000 00000100:00100000:2.0:1789518195.718924:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688512 00000100:00100000:2.0:1789518195.718929:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688512 00000100:00100000:2.0:1789518195.718949:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789518195.718956:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522688000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.718997:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522688000:12345-0@lo:400:kworker.0 Request processed in 41us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518195.719003:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789518195.719018:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789518195.719023:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522688512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.719049:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522688512:12345-0@lo:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518195.719055:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1789518195.719067:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518195.719070:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518195.719092:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522688000:0@lo:400:kworker.0 00010000:00080000:2.0:1789518195.719115:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97df80 x1876445522688512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518195.719127:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522688512:0@lo:400:kworker.0 00010000:00080000:2.0:1789518195.719158:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97dc00 x1876445522687872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518195.719169:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522687872:0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.725718:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522688640:0@lo:400:kworker.0 00000100:00100000:0.0:1789518195.727391:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789518195.727408:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522688384:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518195.728027:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518195.728399:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522688384:12345-0@lo:400:kworker.0 Request processed in 990us (12940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518195.728410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00080000:3.0:1789518195.729689:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97ca80 x1876445522688256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518195.729714:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522688256:0@lo:400:kworker.0 00000100:00100000:2.0:1789518195.733822:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522688384:0@lo:400:kworker.0 00010000:00010000:3.0:1789518195.766562:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518196.213876:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518196.213907:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522688768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518196.214016:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518196.214201:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688768 00000100:00100000:3.0:1789518196.214211:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688768 00000100:00100000:3.0:1789518196.214282:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789518196.214294:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522688768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518196.214324:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518196.214400:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522688768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518196.214406:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789518196.214524:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522688768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518196.725838:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518196.725872:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522688896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518196.725993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518196.726246:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522688896 00000100:00100000:0.0:1789518196.726259:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522688896 00000100:00100000:0.0:1789518196.726328:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518196.726340:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522688896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518196.726380:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518196.726438:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522688896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518196.726447:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:3.0:1789518196.726616:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97d500 x1876445522688896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518196.726637:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522688896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518196.727786:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518196.727805:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522689024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518196.727901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518196.727986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689024 00000100:00100000:3.0:1789518196.727994:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689024 00000100:00100000:3.0:1789518196.728042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789518196.728049:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522689024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518196.728088:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518196.728134:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522689024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518196.728141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789518196.728190:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522689024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518196.736386:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518196.746781:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522689152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518196.746906:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518196.758126:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689152 00000100:00100000:0.0:1789518196.758160:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689152 00000100:00100000:3.0:1789518196.759084:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789518196.759103:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522689152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518196.759162:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518196.760653:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522689152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518196.760753:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522689152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1073us (13265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518196.760766:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00010000:1.0:1789518196.791321:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518197.617301:0:14059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:23:15 (1789518195) 00010000:00010000:3.0:1789518197.815794:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518198.837705:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518199.286019:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522689280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518199.286140:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518199.288155:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689280 00000100:00100000:0.0:1789518199.288174:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689280 00000100:00100000:0.0:1789518199.288304:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789518199.288321:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522689280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789518199.288373:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789518199.288543:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518199.298951:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522689280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10613us (12790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518199.298982:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1789518199.304514:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e74079d3480 x1876445522689280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518199.306521:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522689280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518199.395432:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518199.395827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619712 00000100:00100000:0.0:1789518199.395842:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619712 00000100:00100000:0.0:1789518199.395970:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:0.0:1789518199.395984:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:11061:x1876445501619712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518199.396014:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518199.396044:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.396143:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231450d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.396161:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231450d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.396177:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231450d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518199.396242:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789518199.396246:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518199.396296:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231450d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.396325:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660b9 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.396359:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231450d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660b9 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.396368:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73032eed00) 00010000:00010000:0.0:1789518199.396371:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518199.396375:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d000, rc 0) 00000100:00100000:0.0:1789518199.396461:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+6:11061:x1876445501619712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 481us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518199.396529:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00080000:2.0:1789518199.396988:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518199.410263:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518199.412322:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619840 00000100:00100000:2.0:1789518199.412343:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619840 00000100:00100000:2.0:1789518199.412722:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:2.0:1789518199.412738:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+6:11062:x1876445501619840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518199.412780:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518199.412818:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314514 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660c0 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413023:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413043:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413056:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413074:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413080:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413087:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413195:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942314529 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413218:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942314529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413227:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942314529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518199.413276:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518199.413280:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518199.413307:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942314529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413320:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413328:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413336:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413343:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033adc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518199.413348:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413358:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413371:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73032eed00) 00010000:00010000:2.0:1789518199.413380:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518199.413386:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413403:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231451b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413423:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413430:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413437:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413443:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033aca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518199.413445:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413452:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413460:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e73010b9900) 00010000:00010000:2.0:1789518199.413769:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518199.413774:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.413781:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314522 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.416717:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314514 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660c0 expref: 8 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.416784:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942314529 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660c0 expref: 7 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518199.416794:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:2.0:1789518199.416806:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518199.416811:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac200, rc 0) 00000100:00100000:2.0:1789518199.418898:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+7:11062:x1876445501619840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 6153us (8635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518199.418914:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:1.0:1789518199.437144:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518199.437254:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501619968 00000100:00100000:0.0:1789518199.437268:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501619968 00000100:00100000:0.0:1789518199.437350:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789518199.437362:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5499dd84-083f-4a57-a16b-aad857025063+7:11062:x1876445501619968:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789518199.437528:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5499dd84-083f-4a57-a16b-aad857025063+7:11062:x1876445501619968:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 Request processed in 167us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518199.437537:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789518199.444207:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518199.444503:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501620224 00000100:00100000:0.0:1789518199.444517:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501620224 00000100:00100000:0.0:1789518199.444659:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789518199.444671:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+7:11062:x1876445501620224:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518199.444699:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518199.444726:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314530 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.445029:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.445120:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.445136:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448082:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448137:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448151:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448298:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d200/0x8d0fd67942314545 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448308:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d200/0x8d0fd67942314545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448320:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d200/0x8d0fd67942314545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518199.448333:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789518199.448429:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448436:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448443:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448448:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518199.448453:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448460:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448504:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:0.0:1789518199.448507:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518199.448512:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448531:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314537 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448556:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448562:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448568:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448573:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9dc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518199.448576:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448582:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448589:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e73032ee200) 00010000:00010000:0.0:1789518199.448592:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518199.448595:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.448600:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231453e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.449410:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314530 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660c7 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.449440:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d200/0x8d0fd67942314545 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660c7 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518199.449447:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:0.0:1789518199.449450:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518199.449452:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d200, rc 0) 00000100:00100000:0.0:1789518199.450451:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+9:11062:x1876445501620224:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 5776us (6254us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789518199.450491:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:3.0:1789518199.458877:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518199.459032:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501620352 00000100:00100000:0.0:1789518199.459046:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501620352 00000100:00100000:0.0:1789518199.459131:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:0.0:1789518199.459144:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+9:11062:x1876445501620352:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518199.459294:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+9:11062:x1876445501620352:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 152us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518199.459303:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:3.0:1789518199.463616:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518199.463969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501620480 00000100:00100000:2.0:1789518199.463983:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501620480 00000100:00100000:2.0:1789518199.464135:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:2.0:1789518199.464149:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:11062:x1876445501620480:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789518199.477212:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 12987us 00000100:00080000:0.0:1789518199.478435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518199.539238:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:11062:x1876445501620480:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 75078us (75623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518199.539255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:0.0:1789518199.699337:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518199.699396:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518199.699434:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518199.699505:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518199.699685:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501620608 00000100:00100000:1.0:1789518199.699699:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501620608 00000100:00100000:1.0:1789518199.699770:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 379 00000100:00100000:1.0:1789518199.699808:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501620608:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518199.699916:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501620608:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 122us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518199.699925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 379 00000100:00100000:1.0:1789518199.699969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501620864 00000100:00100000:1.0:1789518199.699973:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501620864 00000100:00100000:1.0:1789518199.700001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501621120 00000100:00100000:1.0:1789518199.700004:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501621120 00000100:00100000:1.0:1789518199.700034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 281 00000100:00100000:1.0:1789518199.700039:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501620864:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518199.700090:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501620864:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 51us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518199.700098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 281 00000100:00100000:1.0:1789518199.700110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 282 00000100:00100000:1.0:1789518199.700116:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501621120:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518199.700140:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501621120:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518199.700147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 282 00000100:00080000:1.0:1789518199.700326:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789518199.700737:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501620736 00000100:00100000:0.0:1789518199.700758:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501620736 00000100:00100000:0.0:1789518199.700803:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 283 00000100:00100000:0.0:1789518199.700812:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501620736:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518199.700870:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501620736:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 59us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518199.700877:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 283 00000100:00100000:0.0:1789518199.701754:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518199.702743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501620992 00000100:00100000:1.0:1789518199.702757:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501620992 00000100:00100000:1.0:1789518199.702856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 284 00000100:00100000:1.0:1789518199.702868:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501620992:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518199.702958:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501620992:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 91us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518199.702985:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 284 00000100:00080000:1.0:1789518199.703015:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518199.861951:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518200.122928:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789518200.127569:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789518200.822720:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518200.822751:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522689408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518200.822866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.822952:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689408 00000100:00100000:2.0:1789518200.822962:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689408 00000100:00100000:2.0:1789518200.823025:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789518200.823036:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522689408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518200.823072:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518200.823142:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522689408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.823151:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789518200.823207:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522689408:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789518200.823348:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518200.825910:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522689664:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.826056:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522690176:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826094:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.826118:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522690688:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.826168:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789518200.826175:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522689536:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826208:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.826234:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522690048:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826259:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.826277:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522690560:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826297:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.826330:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689664 00000100:00100000:2.0:1789518200.826340:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689664 00000100:00100000:2.0:1789518200.826405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690688 00000100:00100000:2.0:1789518200.826409:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690688 00000100:00100000:2.0:1789518200.826444:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789518200.826454:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522689664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826544:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522689664:12345-0@lo:400:kworker.0 Request processed in 90us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.826569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789518200.826589:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789518200.826595:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522690688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826625:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522690688:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.826631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789518200.826654:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690176 00000100:00100000:2.0:1789518200.826658:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690176 00000100:00100000:2.0:1789518200.826687:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690560 00000100:00100000:2.0:1789518200.826690:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690560 00000100:00100000:2.0:1789518200.826709:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518200.826715:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522690176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826747:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522690176:12345-0@lo:400:kworker.0 Request processed in 33us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.826752:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518200.826764:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789518200.826770:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522690560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826810:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522690560:12345-0@lo:400:kworker.0 Request processed in 40us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.826816:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789518200.826834:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689536 00000100:00100000:2.0:1789518200.826838:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689536 00000100:00100000:2.0:1789518200.826865:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789518200.826871:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522689536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.826901:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522689536:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.826917:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789518200.826951:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690048 00000100:00100000:2.0:1789518200.826955:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690048 00000100:00100000:2.0:1789518200.826980:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789518200.826988:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522690048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827023:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522690048:12345-0@lo:400:kworker.0 Request processed in 36us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.827029:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789518200.827066:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522689792:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827094:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.827112:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522690304:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.827171:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522690816:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827194:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.827213:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789518200.827219:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522689920:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827239:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.827250:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522690432:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827274:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.827286:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522690944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827306:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518200.827335:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690944 00000100:00100000:2.0:1789518200.827339:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690944 00000100:00100000:2.0:1789518200.827368:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789518200.827375:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522690944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827417:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522690944:12345-0@lo:400:kworker.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.827423:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789518200.827440:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690304 00000100:00100000:2.0:1789518200.827444:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690304 00000100:00100000:2.0:1789518200.827497:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690816 00000100:00100000:2.0:1789518200.827500:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690816 00000100:00100000:2.0:1789518200.827514:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689920 00000100:00100000:2.0:1789518200.827516:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689920 00000100:00100000:2.0:1789518200.827526:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522690432 00000100:00100000:2.0:1789518200.827528:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522690432 00000100:00100000:2.0:1789518200.827544:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789518200.827550:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522690304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827580:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522690304:12345-0@lo:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.827586:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789518200.827597:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789518200.827603:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522690816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827628:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522690816:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.827633:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789518200.827643:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789518200.827649:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522689920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827672:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522689920:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.827678:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789518200.827691:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789518200.827703:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522690432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827730:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522690432:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518200.827736:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789518200.827795:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522689536:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827814:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522690048:0@lo:400:kworker.0 00010000:00080000:2.0:1789518200.827827:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f880380 x1876445522690560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518200.827837:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522690560:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827849:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522689664:0@lo:400:kworker.0 00010000:00080000:2.0:1789518200.827862:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e74079d1c00 x1876445522690176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518200.827871:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522690176:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827882:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522690688:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827922:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522689920:0@lo:400:kworker.0 00010000:00080000:2.0:1789518200.827931:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f881500 x1876445522690432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518200.827940:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522690432:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827949:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522690944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518200.827957:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522690304:0@lo:400:kworker.0 00010000:00080000:2.0:1789518200.827967:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f882300 x1876445522690816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518200.827983:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522690816:0@lo:400:kworker.0 00000100:00080000:1.0:1789518200.828143:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518200.828149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518200.828151:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518200.828154:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518200.828168:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522689792 00000100:00100000:1.0:1789518200.828173:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522689792 00000100:00100000:1.0:1789518200.828207:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789518200.828215:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522689792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518200.828264:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522689792:12345-0@lo:400:kworker.0 Request processed in 50us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518200.828270:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789518200.828302:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522689792:0@lo:400:kworker.0 00010000:00010000:3.0:1789518200.885747:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518201.334945:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522691072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518201.335051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518201.335366:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522691072 00000100:00100000:0.0:1789518201.335378:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522691072 00000100:00100000:0.0:1789518201.335455:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789518201.335501:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522691072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789518201.335543:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518201.335604:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522691072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518201.335612:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789518201.336520:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522691072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518201.854398:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522691200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518201.854535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518201.855298:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522691200 00000100:00100000:2.0:1789518201.855310:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522691200 00000100:00100000:2.0:1789518201.855378:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789518201.855389:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522691200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518201.855435:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789518201.855950:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522691200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 560us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518201.855959:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789518201.856069:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522691200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518201.860722:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522691328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518201.860848:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518201.860930:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518201.860939:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522691456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518201.860968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518201.861035:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522691456 00000100:00100000:2.0:1789518201.861047:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522691456 00000100:00100000:0.0:1789518201.864680:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522691328 00000100:00100000:0.0:1789518201.864704:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522691328 00000100:00100000:0.0:1789518201.864801:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518201.864815:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522691328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518201.864876:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789518201.864993:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522691328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (4145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518201.865002:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789518201.865568:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789518201.865697:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522691456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518201.865746:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518201.865806:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522691456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (4836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518201.865814:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1789518201.865881:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97e300 x1876445522691456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518201.865909:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522691456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518201.865929:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522691328:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789518201.912115:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518202.167677:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789518202.171874:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789518202.443263:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518202.443325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501621248 00000100:00100000:2.0:1789518202.443335:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501621248 00000100:00080000:3.0:1789518202.443407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518202.443418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:2.0:1789518202.443430:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+9:11104:x1876445501621248:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518202.443450:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518202.443491:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314553 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443628:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443642:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443656:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443670:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443686:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443692:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443747:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443754:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443761:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443775:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518202.443780:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443787:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443926:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73032eed00) 00010000:00010000:2.0:1789518202.443931:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518202.443936:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443944:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231455a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443956:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443967:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443974:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443978:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ada00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518202.443982:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443989:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.443997:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e73010b5000) 00010000:00010000:2.0:1789518202.444000:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518202.444003:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.444008:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314561 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.444393:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314553 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ce expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.444418:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73032eed00) 00010000:00010000:2.0:1789518202.444421:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518202.444425:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314553 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ce expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.444435:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad000, rc 0) 00000100:00100000:2.0:1789518202.444522:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+9:11104:x1876445501621248:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1092us (1262us total) trans 0 rc 301/301 00000100:00100000:2.0:1789518202.444531:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:2.0:1789518202.452568:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518202.452671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501621504 00000100:00100000:3.0:1789518202.452688:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501621504 00000100:00100000:3.0:1789518202.452959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789518202.452972:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+9:11104:x1876445501621504:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:3.0:1789518202.453047:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518202.453080:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231450d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660b9 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.453116:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73032eed00) 00010000:00010000:3.0:1789518202.453127:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518202.453277:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.453310:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.453323:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.453354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.453361:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.453377:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454248:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454276:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454286:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518202.454305:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9fa052 reply state 0000000001ad611a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454319:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454327:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518202.454335:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518202.454339:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789518202.454344:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789518202.454351:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454356:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454374:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454381:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518202.454386:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454395:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454406:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04b00) 00010000:00010000:3.0:1789518202.454408:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518202.454412:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454417:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314568 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518202.454433:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9fa052 reply state 0000000001ad611a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454442:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518202.454448:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e7435d04f00) 00010000:00010000:3.0:1789518202.454450:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518202.454452:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789518202.455130:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+10:11104:x1876445501621504:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 2154us (2579us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789518202.455140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789518202.592313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518202.592424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501621632 00000100:00100000:2.0:1789518202.592435:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501621632 00000100:00100000:2.0:1789518202.592524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:2.0:1789518202.592536:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+10:11112:x1876445501621632:12345-192.168.202.43@tcp:101:lctl.0 00010000:00010000:2.0:1789518202.592562:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518202.592587:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231457d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660d5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.592662:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.592677:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.592691:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518202.592741:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518202.592745:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518202.592817:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.592843:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231457d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660d5 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.592861:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660d5 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.592884:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:2.0:1789518202.592887:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518202.592891:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ada00, rc 0) 00000100:00100000:2.0:1789518202.592966:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+11:11112:x1876445501621632:12345-192.168.202.43@tcp:101:lctl.0 Request processed in 432us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518202.592973:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:0.0:1789518202.685505:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518202.687784:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501621760 00000100:00100000:1.0:1789518202.687802:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501621760 00000100:00100000:1.0:1789518202.687978:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:1.0:1789518202.687991:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+11:11118:x1876445501621760:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789518202.688014:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518202.688035:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd6794231458b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660dc expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688134:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688151:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688162:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688173:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688180:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688188:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688268:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423145a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688277:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423145a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688284:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423145a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518202.688318:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789518202.688323:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789518202.688362:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423145a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688384:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688391:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688397:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688403:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518202.688407:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688415:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688428:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:1.0:1789518202.688431:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518202.688436:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688442:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688455:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688512:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688518:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688529:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518202.688532:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688539:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688548:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e7435d04f00) 00010000:00010000:1.0:1789518202.688550:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518202.688553:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688560:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314599 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688587:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd6794231458b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660dc expref: 13 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688602:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423145a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660dc expref: 12 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.688622:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:1.0:1789518202.688625:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518202.688628:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c600, rc 0) 00000100:00100000:1.0:1789518202.688705:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+12:11118:x1876445501621760:12345-192.168.202.43@tcp:101:bash.0 Request processed in 717us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518202.688713:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:1.0:1789518202.702633:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518202.702820:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501622016 00000100:00100000:0.0:1789518202.702831:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501622016 00000100:00100000:0.0:1789518202.702910:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:0.0:1789518202.702921:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+12:11118:x1876445501622016:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518202.702946:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518202.702968:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423145a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660e3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.703089:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.703188:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.703204:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.703273:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.703283:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.703290:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518202.703878:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789518202.704018:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704028:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704037:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704080:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704086:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704092:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704098:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518202.704103:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704248:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704262:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:0.0:1789518202.704265:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518202.704270:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704276:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518202.704306:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092a4f9ed reply state 00000000926a7cb1 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704318:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704324:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e730335ba00) 00010000:00010000:0.0:1789518202.704332:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518202.704335:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518202.704369:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423145a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704386:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.704393:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e730335b300) 00010000:00010000:0.0:1789518202.704395:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518202.704397:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c600, rc 0) 00000100:00100000:0.0:1789518202.704568:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+15:11118:x1876445501622016:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1648us (1946us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789518202.704576:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:0.0:1789518202.722198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518202.722322:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501622144 00000100:00100000:2.0:1789518202.722334:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501622144 00000100:00100000:2.0:1789518202.722390:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:2.0:1789518202.722399:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1876445501622144:12345-192.168.202.43@tcp:8:bash.0 00010000:00080000:2.0:1789518202.722446:0:8428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:2.0:1789518202.722505:0:8428:0:(genops.c:1384:class_connect()) connect: client 5499dd84-083f-4a57-a16b-aad857025063, cookie 0x8d0fd679423145ca 00002000:00100000:2.0:1789518202.722518:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5499dd84-083f-4a57-a16b-aad857025063/ffff8e74039e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789518202.722529:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789518202.722606:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789518202.722635:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8e74039e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518202.722699:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2386:x1876445501622144:12345-192.168.202.43@tcp:8:bash.0 Request processed in 300us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518202.722707:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:0.0:1789518202.731212:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518202.731548:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501622272 00000100:00100000:2.0:1789518202.731558:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501622272 00000100:00100000:2.0:1789518202.731630:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:2.0:1789518202.731639:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+6:0:x1876445501622272:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518202.731657:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518202.731692:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660ea expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518202.731718:0:13804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789518202.731738:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1789518202.731742:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518202.731750:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.731785:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.731799:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad000, rc 0) 00000100:00100000:2.0:1789518202.731863:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:0:x1876445501622272:12345-192.168.202.43@tcp:101:bash.0 Request processed in 225us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518202.731870:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00080000:3.0:1789518202.731979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518202.740279:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518202.740864:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501622400 00000100:00100000:2.0:1789518202.740876:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501622400 00000100:00100000:2.0:1789518202.740997:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:2.0:1789518202.741011:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:11118:x1876445501622400:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518202.741035:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518202.741057:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660f1 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.741093:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 8 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.741134:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518202.741139:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518202.741145:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.741184:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 8 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.741198:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 8 pid: 13804 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518202.741212:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9982:1876445522691584:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518202.741332:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730348c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518202.746078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518202.746707:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501622528 00000100:00100000:0.0:1789518202.746718:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501622528 00010000:00010000:0.0:1789518202.746775:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 9 pid: 13804 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518202.746826:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:0.0:1789518202.746837:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501622528:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518202.746852:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518202.746878:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 9 pid: 13804 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.746913:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 9 pid: 13804 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.746944:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518202.746948:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518202.746957:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.746967:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518202.747007:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518202.747022:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876445522691712:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789518202.747914:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25300 going to sleep for 11 seconds 00010000:00010000:2.0:1789518202.748330:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cfbc337/0x8d0fd679423145d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ea expref: 9 pid: 13804 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518202.748351:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9982:1876445522691584:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518202.748389:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518202.748404:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ace00, rc 0) 00000100:00100000:2.0:1789518202.749029:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+8:11118:x1876445501622400:12345-192.168.202.43@tcp:101:bash.0 Request processed in 8016us (8756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518202.749056:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:2.0:1789518202.753000:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876445522691712:192.168.202.43@tcp:105: 00010000:00010000:2.0:1789518202.753035:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518202.753122:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501622528:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 6286us (7055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518202.753133:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:0.0:1789518202.761590:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518202.761697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501622784 00000100:00100000:2.0:1789518202.761708:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501622784 00000100:00100000:2.0:1789518202.761777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:2.0:1789518202.761790:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+15:11118:x1876445501622784:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:2.0:1789518202.762123:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+16:11118:x1876445501622784:12345-192.168.202.43@tcp:35:bash.0 Request processed in 322us (529us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789518202.762131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789518202.907430:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518202.908340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501623040 00000100:00100000:1.0:1789518202.908356:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501623040 00000100:00100000:1.0:1789518202.908508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:1.0:1789518202.908520:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+16:11128:x1876445501623040:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518202.908551:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518202.908573:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423145df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518202.908683:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789518202.910754:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423145df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f8 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.910945:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:1.0:1789518202.910948:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518202.910955:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423145df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f8 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518202.910973:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d000, rc 0) 00000100:00100000:1.0:1789518202.911067:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+17:11128:x1876445501623040:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 2548us (3651us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789518202.911076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:2.0:1789518202.915146:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518202.915250:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501623296 00000100:00100000:3.0:1789518202.915262:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501623296 00000100:00100000:3.0:1789518202.915330:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789518202.915340:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+17:11128:x1876445501623296:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789518202.915605:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+18:11128:x1876445501623296:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 265us (469us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789518202.915613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00010000:00010000:1.0:1789518202.933884:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518203.020301:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518203.020943:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501623424 00000100:00100000:0.0:1789518203.020957:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501623424 00000100:00100000:0.0:1789518203.021031:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:0.0:1789518203.021043:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:11134:x1876445501623424:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518203.021071:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518203.021095:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423145ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785660ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.021191:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.021206:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.021218:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518203.021263:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789518203.021267:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518203.021301:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.021329:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423145ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ff expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.021372:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ff expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.021380:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:0.0:1789518203.021382:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518203.021386:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9da00, rc 0) 00000100:00100000:0.0:1789518203.026248:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+19:11134:x1876445501623424:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 5194us (5946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518203.026262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:0.0:1789518203.037603:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.037814:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501623680 00000100:00100000:2.0:1789518203.037827:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501623680 00000100:00100000:2.0:1789518203.037926:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:2.0:1789518203.037938:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:11134:x1876445501623680:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518203.037958:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518203.037977:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423145fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566106 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.038093:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314602 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.038126:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.038139:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518203.038152:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789518203.038266:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423145fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566106 expref: 22 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.038446:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566106 expref: 21 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.038456:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e730335b300) 00010000:00010000:2.0:1789518203.038459:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518203.038583:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad000, rc 0) 00000100:00100000:2.0:1789518203.038681:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+21:11134:x1876445501623680:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 745us (1088us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789518203.038689:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:1.0:1789518203.043212:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.043310:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501623936 00000100:00100000:2.0:1789518203.043322:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501623936 00000100:00100000:2.0:1789518203.043400:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:2.0:1789518203.043410:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+21:11134:x1876445501623936:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518203.043444:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518203.043499:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314610 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856610d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.043643:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314617 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.043660:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.043672:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518203.043685:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789518203.043807:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314610 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856610d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.043826:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314617 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856610d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.043835:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e730335b300) 00010000:00010000:2.0:1789518203.043838:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518203.043842:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad800, rc 0) 00000100:00100000:2.0:1789518203.043909:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+23:11134:x1876445501623936:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 500us (706us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789518203.043917:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:0.0:1789518203.051633:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.051734:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501624064 00000100:00100000:2.0:1789518203.051745:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501624064 00000100:00100000:2.0:1789518203.051829:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:2.0:1789518203.051840:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+23:2390:x1876445501624064:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518203.051856:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518203.051886:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566106 expref: 23 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.051905:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e730335b300) 00010000:00010000:2.0:1789518203.051911:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518203.051973:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+22:2390:x1876445501624064:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 134us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518203.051980:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:3.0:1789518203.056149:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.056295:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501624192 00000100:00100000:2.0:1789518203.056308:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501624192 00000100:00100000:2.0:1789518203.056383:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:2.0:1789518203.056399:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501624192:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:2.0:1789518203.056452:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.056504:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.056511:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518203.056514:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518203.056518:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.056550:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.056560:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 7 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.056584:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876445522691840:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518203.056662:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730348c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518203.058995:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876445522691840:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518203.059023:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518203.064203:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518203.064284:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501624320 00000100:00100000:0.0:1789518203.064296:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501624320 00002000:00100000:0.0:1789518203.064346:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e743f939880 x1876445501624320/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:604/0 lens 504/0 e 0 to 0 dl 1789518214 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518203.064358:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e743f939880 with x1876445501624320 ext(0->12) 00010000:00010000:0.0:1789518203.064369:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 8 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.064387:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 8 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518203.064396:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e743f939880 00000100:00100000:0.0:1789518203.064519:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789518203.064529:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501624320:12345-192.168.202.43@tcp:4:lfs.0 00000001:00100000:0.0:1789518203.065816:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000100:00100000:2.0:1789518203.066401:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501624320:12345-192.168.202.43@tcp:4:lfs.0 Request processed in 1867us (2201us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789518203.066416:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00002000:00100000:2.0:1789518203.066429:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e743f939880 x1876445501624320/t4294967300(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:604/0 lens 504/448 e 0 to 0 dl 1789518214 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518203.066437:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e743f939880 with x1876445501624320 ext(0->12) 00010000:00010000:2.0:1789518203.066446:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.066459:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518203.066493:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e743f939880 00000100:00100000:1.0:1789518203.069339:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.069401:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501624448 00000100:00100000:2.0:1789518203.069412:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501624448 00010000:00010000:2.0:1789518203.069454:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.069669:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:2.0:1789518203.069681:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501624448:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518203.069702:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518203.069722:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789518203.069725:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789518202 00002000:00010000:2.0:1789518203.069727:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789518202 00002000:00010000:2.0:1789518203.069729:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789518202 00002000:00010000:2.0:1789518203.069731:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789518203.069738:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.069749:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.069780:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423145d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660f1 expref: 9 pid: 9982 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.069795:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518203.069798:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518203.069803:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.069809:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.069843:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518203.069872:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.069882:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.069902:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.069905:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501624448:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 226us (573us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518203.069911:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.069912:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00010000:00010000:3.0:1789518203.069919:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.069936:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad200 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518203.069946:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.069955:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.069967:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.069974:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f93b5705/0x8d0fd67942314625 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518203.070028:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501624192:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 13632us (13889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518203.070036:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:1.0:1789518203.072804:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518203.072902:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501624704 00000100:00100000:3.0:1789518203.072912:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501624704 00000100:00100000:3.0:1789518203.072958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:3.0:1789518203.072966:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+22:11134:x1876445501624704:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:3.0:1789518203.073022:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314617 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856610d expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518203.073241:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789518203.073289:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789518203.073825:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1789518203.073855:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.073867:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.073873:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.073899:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.073909:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 26 pid: 6513 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518203.073919:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1876445522691968:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518203.073998:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406dacd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518203.076016:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518203.076037:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1876445522691968:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518203.076066:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.076127:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501624832 00000100:00100000:2.0:1789518203.076135:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501624832 00010000:00010000:2.0:1789518203.076174:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 27 pid: 6513 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.076204:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:2.0:1789518203.076211:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+27:2388:x1876445501624832:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518203.076227:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518203.076234:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 27 pid: 6513 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.076246:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 27 pid: 6513 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.076269:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423145bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660e3 expref: 27 pid: 6513 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.076293:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e730335b300) 00010000:00010000:2.0:1789518203.076298:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.076310:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.076324:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.076408:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518203.076497:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+26:2388:x1876445501624832:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 253us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518203.076505:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00010000:00010000:0.0:1789518203.076948:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.076957:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518203.077091:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789518203.077376:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789518203.077604:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1876445522692096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789518203.077657:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518203.077716:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518203.077747:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522692096 00000100:00100000:2.0:1789518203.077752:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522692096 00000100:00100000:2.0:1789518203.077842:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789518203.077849:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1876445522692096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789518203.077918:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1876445522692096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518203.077925:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789518203.077959:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1876445522692096:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1789518203.077988:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789518203.078087:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789518203.078131:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410739f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1876445522692224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518203.078160:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518203.078180:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417cee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518203.078191:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522692224 00000100:00100000:2.0:1789518203.078195:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522692224 00000100:00100000:2.0:1789518203.078222:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789518203.078229:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1876445522692224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789518203.078354:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1876445522692224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (193us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789518203.078361:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518203.078405:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410739f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1876445522692224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789518203.078561:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789518203.078587:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.078594:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.078599:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.078603:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518203.078606:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.078611:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.078622:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e730335b300) 00010000:00010000:0.0:1789518203.078624:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789518203.078627:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.078631:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd6794231462c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518203.078701:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789518203.078747:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789518203.078755:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370864290940ns, next at 371864289461ns, rc = 0 00000001:00080000:0.0:1789518203.078759:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789518203.078789:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e730335b300) 00010000:00010000:0.0:1789518203.078792:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789518203.078800:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314617 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856610d expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518203.078873:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+29:11134:x1876445501624704:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 5907us (6078us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789518203.078881:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000020:00080000:0.0:1789518203.078885:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518203.080753:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518203.080808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501624960 00000100:00100000:3.0:1789518203.080815:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501624960 00000100:00100000:3.0:1789518203.080880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:3.0:1789518203.080886:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+29:11134:x1876445501624960:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518203.080904:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518203.080922:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314633 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566114 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.080983:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314633 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566114 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.080995:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314633 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566114 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.081008:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518203.081010:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518203.081012:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031600, rc 0) 00000100:00100000:3.0:1789518203.081053:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+30:11134:x1876445501624960:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 167us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518203.081060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:1.0:1789518203.083545:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.083621:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501625216 00000100:00100000:2.0:1789518203.083629:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501625216 00000100:00100000:2.0:1789518203.083670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:2.0:1789518203.083676:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7409e10050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+30:11134:x1876445501625216:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518203.083910:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7409e10050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+31:11134:x1876445501625216:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 232us (373us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789518203.083930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789518203.150732:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.150873:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501625472 00000100:00100000:2.0:1789518203.150885:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501625472 00000100:00100000:2.0:1789518203.150952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:2.0:1789518203.150962:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+31:11144:x1876445501625472:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518203.150992:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518203.151014:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231463a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856611b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518203.151119:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789518203.151216:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231463a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856611b expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.151232:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:2.0:1789518203.151236:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518203.151241:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231463a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856611b expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.151257:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ace00, rc 0) 00000100:00100000:2.0:1789518203.151318:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+32:11144:x1876445501625472:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 358us (598us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789518203.151326:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:1.0:1789518203.155918:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.156013:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501625600 00000100:00100000:2.0:1789518203.156025:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501625600 00000100:00100000:2.0:1789518203.156097:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:2.0:1789518203.156110:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+32:11144:x1876445501625600:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789518203.156210:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156240:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156255:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156269:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156278:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156284:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156400:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156410:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156418:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518203.156538:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156554:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156573:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156580:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156586:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518203.156592:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156600:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156615:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518203.156619:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518203.156625:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156632:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314648 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156645:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156651:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156657:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156662:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ade00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518203.156671:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156677:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156684:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e730335ba00) 00010000:00010000:2.0:1789518203.156687:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518203.156691:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156697:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd6794231464f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156706:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156712:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156718:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156723:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518203.156726:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156731:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156738:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518203.156740:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518203.156750:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.156757:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314656 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.156878:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+32:11144:x1876445501625600:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 769us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518203.156887:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:1.0:1789518203.164198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.164316:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501625856 00000100:00100000:2.0:1789518203.164330:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501625856 00000100:00100000:2.0:1789518203.164399:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789518203.164410:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+32:11144:x1876445501625856:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518203.164681:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+33:11144:x1876445501625856:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 272us (494us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789518203.164689:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789518203.202147:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.202261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501626112 00000100:00100000:2.0:1789518203.202275:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501626112 00000100:00100000:2.0:1789518203.202349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:2.0:1789518203.202362:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+33:11147:x1876445501626112:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518203.202394:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518203.202417:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231465d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566122 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202563:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202579:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202603:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202617:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202625:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202631:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202738:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202747:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202754:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518203.202776:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789518203.202865:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202873:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202879:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202885:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ade00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518203.202896:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202906:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202921:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518203.202925:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518203.202931:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202938:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314664 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202955:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202961:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202967:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202972:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518203.202975:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202981:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.202987:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e730335ba00) 00010000:00010000:2.0:1789518203.202990:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518203.203000:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.203006:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231466b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.203051:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231465d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.203069:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.203076:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518203.203079:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518203.203083:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ace00, rc 0) 00000100:00100000:2.0:1789518203.203164:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+35:11147:x1876445501626112:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 805us (1029us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789518203.203173:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:1.0:1789518203.208868:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.208984:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501626240 00000100:00100000:2.0:1789518203.208997:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501626240 00000100:00100000:2.0:1789518203.209079:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:2.0:1789518203.209092:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+35:11147:x1876445501626240:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789518203.209166:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209185:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209197:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209255:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209263:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209270:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209277:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518203.209281:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209289:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209300:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518203.209303:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518203.209309:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.209316:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314680 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.209405:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+35:11147:x1876445501626240:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 315us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518203.209413:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:1.0:1789518203.214707:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.214812:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501626496 00000100:00100000:2.0:1789518203.214826:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501626496 00000100:00100000:2.0:1789518203.214900:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789518203.214930:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+35:11147:x1876445501626496:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518203.215206:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+36:11147:x1876445501626496:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 277us (511us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789518203.215214:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:1.0:1789518203.561098:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.561338:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501626752 00000100:00100000:2.0:1789518203.561351:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501626752 00000100:00100000:2.0:1789518203.561505:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:2.0:1789518203.561516:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+36:11178:x1876445501626752:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:2.0:1789518203.561545:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518203.561568:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314687 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566129 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.561688:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231468e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.561703:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231468e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.561716:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231468e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518203.561728:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789518203.561861:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314687 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566129 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.561882:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231468e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566129 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.561915:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518203.561918:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518203.561922:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad000, rc 0) 00000100:00100000:2.0:1789518203.561999:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+38:11178:x1876445501626752:12345-192.168.202.43@tcp:101:cat.0 Request processed in 485us (910us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789518203.562006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:1.0:1789518203.567582:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518203.567629:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518203.567680:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501627136 00000100:00100000:1.0:1789518203.567690:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501627136 00000100:00100000:1.0:1789518203.567748:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:1.0:1789518203.567772:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+38:2388:x1876445501627136:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518203.567789:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518203.567812:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd6794231468e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566129 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518203.567830:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:1.0:1789518203.567836:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518203.567884:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+37:2388:x1876445501627136:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 127us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518203.567903:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:3.0:1789518203.568615:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501627008 00000100:00100000:3.0:1789518203.568625:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501627008 00000100:00100000:3.0:1789518203.568673:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:3.0:1789518203.568682:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+37:11178:x1876445501627008:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:3.0:1789518203.570879:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+38:11178:x1876445501627008:12345-192.168.202.43@tcp:35:cat.0 Request processed in 2186us (3295us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789518203.570893:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789518203.643912:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518203.644029:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501627392 00000100:00100000:2.0:1789518203.644039:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501627392 00000100:00100000:2.0:1789518203.644099:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:2.0:1789518203.644108:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+38:11184:x1876445501627392:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:2.0:1789518203.644130:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518203.644133:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518203.644162:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423145f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ff expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.644196:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518203.644201:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518203.644215:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231469c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566130 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.644315:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.644329:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.644358:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.644391:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.644404:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 38 pid: 6513 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.644418:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522692352:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518203.644560:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730348cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518203.662342:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518203.662449:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501627520 00000100:00100000:3.0:1789518203.662460:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501627520 00010000:00010000:3.0:1789518203.662532:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 39 pid: 6513 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518203.662575:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:3.0:1789518203.662585:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+39:2388:x1876445501627520:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518203.662628:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518203.662636:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 39 pid: 6513 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.662650:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 39 pid: 6513 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.662673:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518203.662678:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.662687:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.662695:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518203.662716:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518203.662779:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+39:2388:x1876445501627520:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 195us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518203.662787:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00010000:00010000:2.0:1789518203.662985:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314672 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566122 expref: 38 pid: 6513 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518203.663003:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522692352:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518203.663023:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.663032:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.663038:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518203.663056:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789518203.663222:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231469c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 39 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.663250:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 38 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518203.663257:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518203.663260:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518203.663262:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ade00, rc 0) 00000100:00100000:2.0:1789518203.663308:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+38:11184:x1876445501627392:12345-192.168.202.43@tcp:101:dd.0 Request processed in 19201us (19406us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789518203.663316:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:1.0:1789518203.677303:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518203.677445:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501627648 00000100:00100000:0.0:1789518203.677494:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501627648 00000100:00100000:0.0:1789518203.677576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:0.0:1789518203.677590:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+38:11184:x1876445501627648:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:0.0:1789518203.677623:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518203.677649:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423146b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566137 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.677692:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.677710:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.677722:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.677900:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423146b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.677934:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518203.677957:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:0.0:1789518203.677961:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518203.677966:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d000, rc 0) 00000100:00100000:0.0:1789518203.678049:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+39:11184:x1876445501627648:12345-192.168.202.43@tcp:101:dd.0 Request processed in 463us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518203.678057:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:3.0:1789518203.689166:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518203.689295:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501627904 00000100:00100000:1.0:1789518203.689309:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501627904 00000100:00100000:1.0:1789518203.689399:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:1.0:1789518203.689412:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+39:11184:x1876445501627904:12345-192.168.202.43@tcp:36:dd.0 00010000:00010000:1.0:1789518203.689805:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518203.689828:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518203.689842:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518203.689889:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1789518203.689911:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025c6bfcc reply state 000000000af5ce6d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518203.689925:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518203.689932:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:1.0:1789518203.689935:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789518203.689940:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518203.690063:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+42:11184:x1876445501627904:12345-192.168.202.43@tcp:36:dd.0 Request processed in 652us (912us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789518203.690093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00000020:00080000:1.0:1789518203.690099:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518203.957717:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518204.002090:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.002356:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501628032 00000100:00100000:0.0:1789518204.002379:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501628032 00000100:00080000:3.0:1789518204.002453:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518204.002593:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:0.0:1789518204.002606:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+42:11199:x1876445501628032:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:0.0:1789518204.002653:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518204.002687:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423146c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856613e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002789:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002808:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002822:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002836:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002844:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002873:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002969:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002982:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 43 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.002991:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.003037:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 43 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.003053:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 43 pid: 8781 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518204.003069:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522692480:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518204.003201:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518204.006333:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.006450:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522692480:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518204.006500:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518204.006583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501628288 00000100:00100000:2.0:1789518204.006591:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501628288 00000100:00100000:2.0:1789518204.006653:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789518204.006661:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+44:6159:x1876445501628288:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789518204.008192:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+45:6159:x1876445501628288:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 1522us (1862us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789518204.008207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:3.0:1789518204.010028:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.010081:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501628416 00000100:00100000:1.0:1789518204.010093:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501628416 00010000:00010000:1.0:1789518204.010144:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 45 pid: 8781 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518204.010322:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:1.0:1789518204.010335:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+45:2388:x1876445501628416:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518204.010355:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518204.010372:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 45 pid: 8781 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.010387:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 45 pid: 8781 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.010413:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd679423146a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566130 expref: 45 pid: 8781 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.010434:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:1.0:1789518204.010440:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.010452:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.010460:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.010554:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518204.010582:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.010600:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518204.010614:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+44:2388:x1876445501628416:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 282us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518204.010622:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000004:00200000:3.0:1789518204.010671:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789518204.010677:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518204.010730:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.010747:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.010772:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.010779:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.010786:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.010792:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518204.011911:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.011934:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.011949:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518204.011953:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518204.011958:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.011986:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423146cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012028:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012035:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012042:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012046:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518204.012048:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012053:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012060:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e730335ba00) 00010000:00010000:3.0:1789518204.012062:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518204.012065:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012071:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423146d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012129:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423146c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856613e expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012143:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856613e expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.012154:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518204.012156:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518204.012158:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9dc00, rc 0) 00000100:00100000:3.0:1789518204.012318:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+43:11199:x1876445501628032:12345-192.168.202.43@tcp:101:stat.0 Request processed in 9715us (10243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518204.012325:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:3.0:1789518204.066218:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.066356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501628672 00000100:00100000:1.0:1789518204.066371:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501628672 00000100:00100000:1.0:1789518204.066447:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:1.0:1789518204.066460:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+43:11205:x1876445501628672:12345-192.168.202.43@tcp:36:truncate.0 00010000:00010000:1.0:1789518204.066567:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518204.066602:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423146db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856613e expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.066641:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:1.0:1789518204.066647:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518204.066881:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.066899:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.066912:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518204.066964:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789518204.066987:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6fd9833 reply state 000000004b072d28 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.067001:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.067027:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:1.0:1789518204.067030:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789518204.067033:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518204.067232:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+45:11205:x1876445501628672:12345-192.168.202.43@tcp:36:truncate.0 Request processed in 773us (1028us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789518204.067241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000020:00080000:1.0:1789518204.067247:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789518204.205041:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.210652:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501628800 00000100:00100000:2.0:1789518204.210676:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501628800 00000100:00100000:2.0:1789518204.210785:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789518204.210807:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+45:11219:x1876445501628800:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:2.0:1789518204.210841:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518204.210868:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423146e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566145 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.210961:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211217:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211231:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211247:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211254:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211261:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211367:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211377:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211385:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518204.211442:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789518204.211447:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518204.211516:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211531:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211552:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211559:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211566:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211573:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.211578:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211587:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211601:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518204.211604:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.211610:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211617:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423146f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211644:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211652:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211657:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211669:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033adc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.211673:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211678:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211687:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e730335ba00) 00010000:00010000:2.0:1789518204.211690:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.211692:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211698:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423146f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211734:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423146e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211750:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.211767:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.211770:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518204.211772:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033aca00, rc 0) 00000100:00100000:2.0:1789518204.212340:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+46:11219:x1876445501628800:12345-192.168.202.43@tcp:101:stat.0 Request processed in 1541us (7312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.212358:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:0.0:1789518204.315618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.315887:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501629056 00000100:00100000:1.0:1789518204.315901:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501629056 00000100:00100000:1.0:1789518204.316108:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:1.0:1789518204.316123:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+46:11229:x1876445501629056:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518204.316154:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518204.316184:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856614c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518204.316343:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789518204.316512:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314705 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856614c expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.316529:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:1.0:1789518204.316533:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518204.316539:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856614c expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.316557:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0cc00, rc 0) 00000100:00100000:1.0:1789518204.316639:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+47:11229:x1876445501629056:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 520us (1037us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1789518204.316667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:3.0:1789518204.322004:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.322280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501629312 00000100:00100000:0.0:1789518204.322298:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501629312 00000100:00100000:0.0:1789518204.322732:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:0.0:1789518204.322747:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+47:11229:x1876445501629312:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518204.323167:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+48:11229:x1876445501629312:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 421us (1182us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789518204.323177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:0.0:1789518204.400907:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518204.401161:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501629568 00000100:00100000:3.0:1789518204.401175:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501629568 00000100:00100000:3.0:1789518204.401258:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:3.0:1789518204.401270:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+48:11235:x1876445501629568:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518204.401303:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518204.401327:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314713 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566153 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.401521:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.401539:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.401549:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.401591:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.401628:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 49 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518204.401645:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522692608:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518204.401763:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406dace40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518204.405557:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.405674:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501629696 00000100:00100000:2.0:1789518204.405709:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501629696 00010000:00010000:2.0:1789518204.405772:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 50 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518204.405824:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:2.0:1789518204.405837:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+50:2387:x1876445501629696:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518204.405860:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518204.405867:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 50 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.405879:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 50 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.405904:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.405909:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.405919:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.405926:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.405945:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518204.406020:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+50:2387:x1876445501629696:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 185us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.406028:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00010000:00010000:3.0:1789518204.406268:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423146fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566145 expref: 49 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518204.406291:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522692608:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518204.406319:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.406336:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.406343:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518204.406349:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00200000:3.0:1789518204.406415:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000100:00100000:1.0:1789518204.406643:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522692736:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789518204.406646:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314713 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.406668:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.406677:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518204.406688:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518204.406691:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031800, rc 0) 00000100:00100000:3.0:1789518204.406739:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+49:11235:x1876445501629568:12345-192.168.202.43@tcp:101:bash.0 Request processed in 5470us (5846us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789518204.406747:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789518204.406772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518204.406988:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522692736 00000100:00100000:2.0:1789518204.406996:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522692736 00000100:00100000:2.0:1789518204.407116:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789518204.407124:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522692736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518204.407155:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789518204.407201:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522692736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.407207:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789518204.407276:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522692736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789518204.407309:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518204.409790:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.409956:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501629952 00000100:00100000:2.0:1789518204.409969:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501629952 00000100:00100000:2.0:1789518204.410161:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:2.0:1789518204.410176:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+49:11235:x1876445501629952:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:2.0:1789518204.410554:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.410593:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.410609:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518204.410679:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789518204.410703:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfa05c04 reply state 000000001896beaf transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.410719:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.410728:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.410731:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518204.410736:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518204.410870:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+52:11235:x1876445501629952:12345-192.168.202.43@tcp:36:bash.0 Request processed in 696us (1092us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789518204.411439:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00000020:00080000:2.0:1789518204.411448:0:8781:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789518204.421584:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.422036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501630080 00000100:00100000:2.0:1789518204.422053:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501630080 00000100:00100000:3.0:1789518204.422420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:3.0:1789518204.422436:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+52:11235:x1876445501630080:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518204.422500:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518204.422531:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231472f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856615a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.422663:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.422681:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.422690:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.422731:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.422745:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 53 pid: 6515 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518204.422769:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522692864:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518204.422898:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406dace40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518204.428845:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f996680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522692864:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518204.428891:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518204.429137:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.429709:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501630208 00000100:00100000:2.0:1789518204.429719:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501630208 00010000:00010000:2.0:1789518204.429776:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 54 pid: 6515 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518204.429823:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:2.0:1789518204.429836:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+54:2387:x1876445501630208:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518204.429859:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518204.429868:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 54 pid: 6515 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.429882:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 54 pid: 6515 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.429908:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd6794231471a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566153 expref: 54 pid: 6515 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.429929:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.429934:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.429946:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.429976:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.430007:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518204.430086:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+53:2387:x1876445501630208:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 252us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.430093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00010000:00010000:3.0:1789518204.430238:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.430247:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518204.430320:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789518204.430326:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518204.430352:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.430390:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231472f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856615a expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.430407:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856615a expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.430416:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518204.430419:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518204.430432:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031e00, rc 0) 00000100:00100000:3.0:1789518204.430520:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+52:11235:x1876445501630080:12345-192.168.202.43@tcp:101:bash.0 Request processed in 8033us (8904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518204.430529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:0.0:1789518204.446432:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.446678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501630464 00000100:00100000:2.0:1789518204.446691:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501630464 00000100:00100000:2.0:1789518204.446771:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:2.0:1789518204.446783:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7409e13050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+52:11235:x1876445501630464:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:2.0:1789518204.447145:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7409e13050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+53:11235:x1876445501630464:12345-192.168.202.43@tcp:35:bash.0 Request processed in 363us (739us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789518204.447155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:0.0:1789518204.581245:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.581558:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501630720 00000100:00100000:1.0:1789518204.581573:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501630720 00000100:00100000:1.0:1789518204.581653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:1.0:1789518204.581665:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+53:11245:x1876445501630720:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518204.581702:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518204.581736:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd6794231473d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566161 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518204.581917:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789518204.582080:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd6794231473d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566161 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.582098:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:1.0:1789518204.582101:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518204.582108:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd6794231473d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566161 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.582128:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d800, rc 0) 00000100:00100000:1.0:1789518204.582214:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+54:11245:x1876445501630720:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 551us (997us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789518204.582254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00000001:00080000:0.0:1789518204.585819:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:0.0:1789518204.585870:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789518204.585990:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586004:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586013:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586020:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcfa00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.586025:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586033:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586066:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e7435d04f00) 00010000:00010000:2.0:1789518204.586069:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.586075:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586081:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd6794231456f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586102:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586107:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586112:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586117:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.586119:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586130:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586137:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518204.586139:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.586142:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586147:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314576 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586173:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586179:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586184:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586189:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.586191:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586197:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586204:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e730335ba00) 00010000:00010000:2.0:1789518204.586207:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.586210:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586216:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd679423145b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586237:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586244:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586249:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586259:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.586262:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586267:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586276:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.586278:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.586281:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586286:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd679423146bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586298:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586304:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586310:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586314:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.586317:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586324:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586344:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.586347:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.586350:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586356:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd679423146e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586368:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586373:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586379:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586384:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.586386:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586391:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586398:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.586399:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.586401:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.586407:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314728 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518204.586902:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522692992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518204.586965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518204.587082:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522692992 00000100:00100000:3.0:1789518204.587095:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522692992 00000100:00100000:3.0:1789518204.587139:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518204.587146:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522692992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789518204.587170:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789518204.587196:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa9e17a, atime: 0x6aa9e17a, ctime: 0x6aa9e17a, blocks: 0x8 00010000:00010000:3.0:1789518204.587203:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.587217:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1789518204.587221:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518204.587228:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.587243:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.587252:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.587260:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.587276:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518204.587487:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518204.587504:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.587513:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518204.587516:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.587525:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.587539:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.587546:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a59de57/0x8d0fd6794231474b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.587563:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518204.587566:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518204.587567:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789518204.587742:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7410f2d300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789518204.587746:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e743b7cde00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7410f2dc00 00000020:00080000:0.0:1789518204.587759:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e743b7cd500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7302364c00 00000020:00080000:1.0:1789518204.587875:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789518204.588002:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789518204.588112:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1876445522692992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 965us (1145us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789518204.588120:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00080000:2.0:1789518204.588178:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e743f93e680/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789518204.588184:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522692992:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518204.591362:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.591632:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501630848 00000100:00100000:2.0:1789518204.591642:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501630848 00000100:00100000:2.0:1789518204.591699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:2.0:1789518204.591709:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+12:11245:x1876445501630848:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789518204.591822:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591844:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591858:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591876:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591883:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591889:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591962:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591981:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.591988:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518204.592041:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592054:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592061:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592068:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592073:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033adc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.592077:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592084:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592095:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518204.592098:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.592103:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592108:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314752 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592128:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592134:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592139:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592144:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.592146:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592151:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592159:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e73010b5b00) 00010000:00010000:2.0:1789518204.592161:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.592164:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592169:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314759 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592187:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592193:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592199:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592209:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.592212:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592218:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592226:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.592228:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.592231:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.592237:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314760 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518204.592429:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+12:11245:x1876445501630848:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 719us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.592437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:3.0:1789518204.595413:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.595984:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501631104 00000100:00100000:2.0:1789518204.595996:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501631104 00000100:00100000:2.0:1789518204.596106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:2.0:1789518204.596118:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+12:11245:x1876445501631104:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518204.596359:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+13:11245:x1876445501631104:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 243us (956us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789518204.596367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789518204.662318:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.662412:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501631360 00000100:00100000:1.0:1789518204.662433:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501631360 00000100:00100000:1.0:1789518204.662525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:1.0:1789518204.662535:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+13:11248:x1876445501631360:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518204.662576:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518204.662596:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566168 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662671:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662686:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662697:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662711:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662718:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662724:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662848:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231477c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662858:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231477c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662866:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231477c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518204.662876:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789518204.662961:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662969:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662975:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662981:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0ca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518204.662985:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.662992:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663003:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:1.0:1789518204.663006:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518204.663011:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663018:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd6794231476e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663032:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663038:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663044:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663048:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518204.663057:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663065:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663073:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e740ddc0700) 00010000:00010000:1.0:1789518204.663075:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518204.663078:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663084:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663127:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566168 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663141:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231477c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566168 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518204.663149:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:1.0:1789518204.663151:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518204.663154:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c800, rc 0) 00000100:00100000:1.0:1789518204.663220:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+15:11248:x1876445501631360:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 687us (911us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789518204.663228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:3.0:1789518204.669746:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518204.669805:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.669879:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501631488 00000100:00100000:0.0:1789518204.669888:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501631488 00000100:00100000:0.0:1789518204.669943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:0.0:1789518204.669950:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+15:11248:x1876445501631488:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:0.0:1789518204.670020:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670034:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670044:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670085:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670090:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670095:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670098:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518204.670101:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670106:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670115:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:0.0:1789518204.670117:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518204.670120:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.670124:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd6794231478a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518204.670187:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+15:11248:x1876445501631488:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 237us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518204.670191:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:2.0:1789518204.670249:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501631616 00000100:00100000:2.0:1789518204.670252:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501631616 00000100:00100000:2.0:1789518204.670285:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:2.0:1789518204.670295:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+15:2388:x1876445501631616:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518204.670304:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518204.670319:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231477c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566168 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.670330:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.670333:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518204.670353:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+14:2388:x1876445501631616:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 57us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.670359:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:3.0:1789518204.674047:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.674140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501631872 00000100:00100000:0.0:1789518204.674151:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501631872 00000100:00100000:0.0:1789518204.674207:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:0.0:1789518204.674239:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+14:11248:x1876445501631872:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518204.674799:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+15:11248:x1876445501631872:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 560us (761us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789518204.674809:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:1.0:1789518204.824835:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.824883:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.824920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.824948:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518204.824990:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.825079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501632512 00000100:00100000:0.0:1789518204.825090:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501632512 00000100:00100000:0.0:1789518204.825152:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501632128 00000100:00100000:0.0:1789518204.825156:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501632128 00000100:00100000:0.0:1789518204.825173:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501632384 00000100:00100000:0.0:1789518204.825175:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501632384 00000100:00100000:0.0:1789518204.825193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 291 00000100:00100000:0.0:1789518204.825201:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501632512:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518204.825270:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501632512:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 69us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518204.825277:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 291 00000100:00100000:0.0:1789518204.825294:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 292 00000100:00100000:0.0:1789518204.825301:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501632128:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518204.825326:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501632128:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518204.825332:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 292 00000100:00100000:0.0:1789518204.825356:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 293 00000100:00100000:0.0:1789518204.825363:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501632384:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518204.825387:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501632384:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518204.825393:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 293 00000100:00080000:1.0:1789518204.825657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518204.825661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518204.825725:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501632256 00000100:00100000:3.0:1789518204.825730:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501632256 00000100:00100000:3.0:1789518204.825790:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:3.0:1789518204.825797:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2389:x1876445501632256:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518204.825828:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2389:x1876445501632256:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518204.825834:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00080000:1.0:1789518204.826217:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518204.826514:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501632000 00000100:00100000:2.0:1789518204.826522:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501632000 00000100:00100000:2.0:1789518204.826571:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 381 00000100:00100000:2.0:1789518204.826580:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501632000:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518204.826632:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501632000:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 54us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.826639:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 381 00000100:00100000:1.0:1789518204.854898:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.855011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501632768 00000100:00100000:0.0:1789518204.855020:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501632768 00000100:00100000:0.0:1789518204.855092:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:0.0:1789518204.855103:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+15:11266:x1876445501632768:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:0.0:1789518204.855128:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518204.855151:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314791 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856616f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.855692:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314798 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.855710:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314798 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.855721:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314798 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518204.855735:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789518204.855861:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314791 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856616f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.855879:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314798 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856616f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.855887:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:0.0:1789518204.855889:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789518204.855893:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6000, rc 0) 00000100:00100000:0.0:1789518204.856014:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+17:11266:x1876445501632768:12345-192.168.202.43@tcp:101:cat.0 Request processed in 912us (1128us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789518204.856040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:1.0:1789518204.892185:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518204.892679:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501632896 00000100:00100000:3.0:1789518204.892691:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501632896 00000100:00100000:3.0:1789518204.892763:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:3.0:1789518204.892774:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+17:11267:x1876445501632896:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518204.892800:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518204.892821:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566176 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.892890:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423147ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.892904:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423147ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.892915:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423147ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518204.892961:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789518204.892978:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518204.893001:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423147ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.893028:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566176 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.893049:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423147ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566176 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518204.893058:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518204.893061:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518204.893065:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031800, rc 0) 00000100:00100000:3.0:1789518204.893327:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+18:11267:x1876445501632896:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 554us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518204.893334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:3.0:1789518204.901322:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.901508:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501633280 00000100:00100000:2.0:1789518204.901519:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501633280 00000100:00100000:2.0:1789518204.901589:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:2.0:1789518204.901600:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+18:11267:x1876445501633280:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518204.901941:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+19:11267:x1876445501633280:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 343us (632us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789518204.901949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:1.0:1789518204.909161:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.909278:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501633408 00000100:00100000:2.0:1789518204.909304:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501633408 00000100:00100000:2.0:1789518204.909409:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:2.0:1789518204.909429:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+19:11267:x1876445501633408:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:2.0:1789518204.909445:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518204.909722:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314736 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856615a expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.909760:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314798 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856616f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.909773:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314633 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566114 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.909783:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.909788:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518204.909848:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+16:11267:x1876445501633408:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 421us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.909855:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789518204.912269:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518204.912388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501633536 00000100:00100000:0.0:1789518204.912399:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501633536 00000100:00100000:0.0:1789518204.912528:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:0.0:1789518204.912542:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+16:11267:x1876445501633536:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:0.0:1789518204.912709:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.912728:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518204.912742:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518204.913001:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518204.913161:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789518204.913253:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789518204.913348:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+16:11267:x1876445501633536:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 808us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518204.913357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:3.0:1789518204.938390:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518204.938509:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501633664 00000100:00100000:2.0:1789518204.938521:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501633664 00000100:00100000:2.0:1789518204.938580:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:2.0:1789518204.938590:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+16:11269:x1876445501633664:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518204.938611:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518204.938631:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423147bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856617d expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938694:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938728:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938740:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938765:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938774:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938781:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938866:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938877:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938884:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518204.938937:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789518204.938942:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518204.938964:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938978:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.938998:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939003:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939011:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939017:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.939021:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939030:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939044:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518204.939047:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.939053:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939059:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd679423147c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939074:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939081:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939087:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939098:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033adc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518204.939101:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939107:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939116:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e73010b5b00) 00010000:00010000:2.0:1789518204.939119:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518204.939121:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939127:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd679423147c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939162:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd679423147bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 18 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939177:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 17 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518204.939183:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518204.939186:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518204.939189:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad600, rc 0) 00000100:00100000:2.0:1789518204.939262:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+17:11269:x1876445501633664:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 673us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518204.939269:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 77 00010000:00010000:1.0:1789518204.981696:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518205.238369:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518205.238379:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518205.238425:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789518205.238435:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518205.238618:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522693120:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518205.238719:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518205.246756:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.246988:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501633792 00000100:00100000:2.0:1789518205.247012:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501633792 00000100:00100000:2.0:1789518205.247075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:2.0:1789518205.247085:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501633792:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518205.247118:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518205.247257:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501633792:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 172us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.247264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:1.0:1789518205.247796:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522693120:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518205.255712:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.259683:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501633920 00000100:00100000:3.0:1789518205.259698:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501633920 00000100:00100000:3.0:1789518205.259786:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:3.0:1789518205.259798:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+17:11280:x1876445501633920:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.259876:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.259894:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.259933:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.259994:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260003:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260009:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260035:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260043:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260049:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518205.260096:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789518205.260100:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518205.260117:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260127:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260134:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260149:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260155:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518205.260159:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260166:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260177:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:3.0:1789518205.260180:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518205.260185:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260191:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423147d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260202:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260208:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260213:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260218:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518205.260220:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260234:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260242:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8e7435d04900) 00010000:00010000:3.0:1789518205.260245:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518205.260247:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260252:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423147de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260268:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260273:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260278:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260283:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518205.260285:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260290:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260298:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518205.260300:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518205.260302:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.260317:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423147e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.260401:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+17:11280:x1876445501633920:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 605us (4699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.260409:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:2.0:1789518205.273035:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518205.273619:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501634176 00000100:00100000:0.0:1789518205.273631:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501634176 00000100:00100000:0.0:1789518205.273705:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:0.0:1789518205.273714:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+17:11280:x1876445501634176:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518205.273736:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518205.273765:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423147ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566184 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.273874:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.273888:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.273899:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518205.273910:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789518205.273992:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274000:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274010:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274015:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518205.274019:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274028:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274050:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:0.0:1789518205.274052:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518205.274057:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274063:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423147f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274102:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423147ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566184 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274111:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:0.0:1789518205.274114:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518205.274117:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423147ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566184 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.274125:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7c00, rc 0) 00000100:00100000:0.0:1789518205.274188:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501634176:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 475us (1163us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1789518205.274195:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:0.0:1789518205.281908:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.282147:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501634304 00000100:00100000:2.0:1789518205.282161:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501634304 00000100:00100000:2.0:1789518205.282221:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:2.0:1789518205.282242:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501634304:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518205.282286:0:8781:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518205.282435:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501634304:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 205us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.282443:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:0.0:1789518205.294973:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.295125:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501634560 00000100:00100000:3.0:1789518205.295136:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501634560 00000100:00100000:3.0:1789518205.295199:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:3.0:1789518205.295209:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501634560:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.295230:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518205.295233:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518205.295261:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423147ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566176 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.295281:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518205.295285:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518205.295298:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314801 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856618b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518205.295732:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789518205.295889:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314808 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.295904:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.295916:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.295988:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314801 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856618b expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.296005:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856618b expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.296013:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:3.0:1789518205.296015:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518205.296017:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031600, rc 0) 00000100:00100000:3.0:1789518205.296077:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+19:11280:x1876445501634560:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 870us (1114us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789518205.296086:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:0.0:1789518205.305220:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.305306:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501634816 00000100:00100000:3.0:1789518205.305318:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501634816 00000100:00100000:3.0:1789518205.305391:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:3.0:1789518205.305402:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:11280:x1876445501634816:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.305507:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518205.305536:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314808 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856618b expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305557:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:3.0:1789518205.305568:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518205.305590:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305604:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305629:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305646:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305654:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305659:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305707:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305715:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305721:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305727:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518205.305731:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305739:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305756:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518205.305759:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518205.305762:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305775:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314816 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305786:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305792:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305796:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305801:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518205.305804:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305809:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305815:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8fa0f96c (ffff8e7435d04000) 00010000:00010000:3.0:1789518205.305817:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518205.305819:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.305824:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd6794231481d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8fa0f96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.305911:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501634816:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 511us (702us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518205.305919:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:2.0:1789518205.312046:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.312133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501634944 00000100:00100000:3.0:1789518205.312148:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501634944 00000100:00100000:3.0:1789518205.312223:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:3.0:1789518205.312241:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501634944:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.312263:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518205.312290:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314824 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566192 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.312332:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.312356:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.312367:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.312530:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314824 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.312564:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.312572:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:3.0:1789518205.312576:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518205.312580:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9ca00, rc 0) 00000100:00100000:3.0:1789518205.312639:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+19:11280:x1876445501634944:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 407us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.312646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:0.0:1789518205.324029:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.324108:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501635200 00000100:00100000:3.0:1789518205.324120:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501635200 00000100:00100000:3.0:1789518205.324182:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:3.0:1789518205.324192:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:11280:x1876445501635200:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.324277:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.324295:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.324309:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518205.324518:0:8781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789518205.324529:0:8781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373110064783ns, next at 374110062338ns, rc = 0 00000004:00010000:3.0:1789518205.324581:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f98c6014 reply state 00000000ff910b71 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.324595:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.324603:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:3.0:1789518205.324606:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789518205.324610:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518205.324703:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+21:11280:x1876445501635200:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 512us (684us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789518205.324710:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:1.0:1789518205.332913:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.333122:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501635328 00000100:00100000:3.0:1789518205.333133:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501635328 00000100:00100000:3.0:1789518205.333194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00100000:3.0:1789518205.333204:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+21:11280:x1876445501635328:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.333241:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518205.333260:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566199 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.333317:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.333333:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.333363:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:3.0:1789518205.333366:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518205.333370:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c200, rc 0) 00000100:00100000:3.0:1789518205.333441:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+22:11280:x1876445501635328:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 238us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.333448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00100000:3.0:1789518205.342569:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518205.342658:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501635456 00000100:00100000:1.0:1789518205.342669:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501635456 00000100:00100000:1.0:1789518205.342715:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:1.0:1789518205.342725:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1876445501635456:12345-192.168.202.43@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789518205.342773:0:8427:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:1.0:1789518205.342808:0:8427:0:(genops.c:1384:class_connect()) connect: client 5499dd84-083f-4a57-a16b-aad857025063, cookie 0x8d0fd67942314840 00002000:00100000:1.0:1789518205.342820:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5499dd84-083f-4a57-a16b-aad857025063/ffff8e7303532800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789518205.342842:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789518205.342930:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789518205.342962:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8e7423638800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518205.343036:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2386:x1876445501635456:12345-192.168.202.43@tcp:8:lhsmtool_posix.0 Request processed in 312us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518205.343044:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:2.0:1789518205.346670:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.346772:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501635584 00000100:00100000:3.0:1789518205.346783:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501635584 00000100:00100000:3.0:1789518205.346859:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:3.0:1789518205.346870:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+6:0:x1876445501635584:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789518205.347066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789518205.359800:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1789518205.359815:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000100:00100000:2.0:1789518205.359946:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:0:x1876445501635584:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 13071us (13277us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789518205.359955:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:0.0:1789518205.363694:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.365535:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501635840 00000100:00100000:3.0:1789518205.365547:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501635840 00000100:00100000:3.0:1789518205.365605:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789518205.365615:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+22:11280:x1876445501635840:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518205.365845:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+23:11280:x1876445501635840:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 231us (2159us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789518205.365865:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:2.0:1789518205.368635:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.368730:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501636096 00000100:00100000:3.0:1789518205.368739:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501636096 00000100:00100000:3.0:1789518205.368806:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:3.0:1789518205.368816:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+23:11280:x1876445501636096:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789518205.368936:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+23:11280:x1876445501636096:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.368944:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:2.0:1789518205.379008:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518205.379209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501636224 00000100:00100000:0.0:1789518205.379219:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501636224 00000100:00100000:0.0:1789518205.379287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:0.0:1789518205.379297:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+23:11280:x1876445501636224:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518205.379318:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518205.379346:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.379429:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd6794231484e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.379445:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd6794231484e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.379455:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd6794231484e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518205.379530:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518205.379549:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd6794231484e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.379575:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a0 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.379592:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd6794231484e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a0 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.379601:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:0.0:1789518205.379604:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789518205.379608:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6400, rc 0) 00000100:00100000:0.0:1789518205.379668:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+24:11280:x1876445501636224:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 372us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518205.379684:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:2.0:1789518205.392325:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518205.392428:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501636352 00000100:00100000:1.0:1789518205.392440:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501636352 00000100:00100000:1.0:1789518205.392524:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:1.0:1789518205.392534:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501636352:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518205.392564:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518205.392587:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661a7 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518205.392614:0:13804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e17d, blocks: 0x0 00010000:00010000:1.0:1789518205.392633:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1789518205.392638:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518205.392648:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 6 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.392670:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 6 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.392683:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0ce00, rc 0) 00000100:00100000:1.0:1789518205.392733:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501636352:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 201us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518205.392740:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:2.0:1789518205.407903:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.407947:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501636608 00000100:00100000:2.0:1789518205.407957:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501636608 00000100:00100000:2.0:1789518205.408017:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:2.0:1789518205.408027:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+24:11280:x1876445501636608:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518205.408121:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+24:11280:x1876445501636608:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.408128:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:2.0:1789518205.419401:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.419517:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501636736 00000100:00100000:3.0:1789518205.419527:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501636736 00000100:00100000:3.0:1789518205.419578:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:3.0:1789518205.419587:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+6:11280:x1876445501636736:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.419606:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518205.419627:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661ae expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.419659:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.419669:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518205.419674:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518205.419679:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.419711:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.419739:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 7 pid: 13804 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.419766:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f996a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1876445522693248:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518205.419848:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518205.423134:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518205.423210:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501636864 00000100:00100000:0.0:1789518205.423220:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501636864 00010000:00010000:0.0:1789518205.423260:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 8 pid: 13804 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518205.423306:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:0.0:1789518205.423316:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501636864:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518205.423331:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518205.423364:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 8 pid: 13804 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.423379:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 8 pid: 13804 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.423402:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518205.423416:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518205.423426:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.423436:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.423491:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518205.423527:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1876445522693376:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789518205.423601:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25240 going to sleep for 11 seconds 00010000:00010000:3.0:1789518205.424215:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd67942314855 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a7 expref: 8 pid: 13804 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.424233:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f996a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1876445522693248:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518205.424260:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.424271:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9dc00, rc 0) 00000100:00100000:3.0:1789518205.424318:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:11280:x1876445501636736:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 4732us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.424327:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:0.0:1789518205.434949:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1876445522693376:192.168.202.43@tcp:105: 00010000:00010000:0.0:1789518205.434977:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518205.435038:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501636864:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 11723us (11912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518205.435049:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:2.0:1789518205.437391:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518205.437503:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501636992 00000100:00100000:1.0:1789518205.437515:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501636992 00002000:00100000:1.0:1789518205.437561:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8e7410739500 x1876445501636992/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:606/0 lens 504/0 e 0 to 0 dl 1789518216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518205.437573:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7410739500 with x1876445501636992 ext(0->8) 00002000:00010000:1.0:1789518205.437578:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7410739500 00000100:00100000:1.0:1789518205.437606:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:1.0:1789518205.437615:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501636992:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518205.439015:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501636992:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 1393us (1627us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789518205.439028:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00002000:00100000:1.0:1789518205.439039:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8e7410739500 x1876445501636992/t4294967303(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:606/0 lens 504/448 e 0 to 0 dl 1789518216 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518205.439048:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7410739500 with x1876445501636992 ext(0->8) 00002000:00010000:1.0:1789518205.439053:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7410739500 00000100:00100000:2.0:1789518205.442222:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.442290:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501637120 00000100:00100000:3.0:1789518205.442300:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501637120 00000100:00100000:3.0:1789518205.442360:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 90 00000100:00100000:3.0:1789518205.442370:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+24:11280:x1876445501637120:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789518205.452759:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789518205.452773:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789518205.452812:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789518205.452835:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789518205.452845:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789518205.453029:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522693504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518205.453101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518205.455084:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.455100:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.455123:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.455129:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518205.455133:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.455142:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.455157:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:3.0:1789518205.455160:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518205.455165:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.455172:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314832 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.455330:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+14:11280:x1876445501637120:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 12956us (13111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.455340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 90 00000100:00100000:0.0:1789518205.461137:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.461257:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522693504 00000100:00100000:2.0:1789518205.461267:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522693504 00000100:00100000:2.0:1789518205.461318:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501637248 00000100:00100000:2.0:1789518205.461322:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501637248 00000100:00100000:2.0:1789518205.461356:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789518205.461367:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522693504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789518205.461706:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789518205.461722:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789518205 00002000:00010000:2.0:1789518205.461725:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518205.461727:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789518205 -> 1789518205 00002000:00010000:2.0:1789518205.461730:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789518205.461790:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522693504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 425us (8689us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789518205.461797:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789518205.461815:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:2.0:1789518205.461821:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501637248:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1789518205.461865:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789518205.461899:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e743f93f480/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789518205.461906:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522693504:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1789518205.463506:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1789518205.463519:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1789518205.463731:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501637248:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 1905us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.463753:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:1.0:1789518205.477618:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.478039:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501637504 00000100:00100000:2.0:1789518205.478049:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501637504 00000100:00100000:2.0:1789518205.478107:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:2.0:1789518205.478117:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+14:11280:x1876445501637504:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518205.478166:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518205.478192:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd6794231484e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661a0 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.478208:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:2.0:1789518205.478214:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518205.478243:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.478270:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.478279:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518205.478423:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acee06bf reply state 00000000867c6ae3 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.478435:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.478442:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:2.0:1789518205.478444:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518205.478447:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518205.478570:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+15:11280:x1876445501637504:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 453us (962us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789518205.478577:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:2.0:1789518205.481523:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.481779:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501637632 00000100:00100000:3.0:1789518205.481789:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501637632 00000100:00100000:3.0:1789518205.481847:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:3.0:1789518205.481857:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501637632:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789518205.482034:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789518205.482038:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789518205 -> 1789518204 00002000:00010000:3.0:1789518205.482040:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789518202 00002000:00010000:3.0:1789518205.482043:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789518205 -> 1789518204 00002000:00010000:3.0:1789518205.482045:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789518205.482106:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501637632:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 250us (591us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789518205.482114:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:3.0:1789518205.484521:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.484655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501637888 00000100:00100000:2.0:1789518205.484664:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501637888 00000100:00100000:2.0:1789518205.484720:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:2.0:1789518205.484729:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+15:11280:x1876445501637888:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518205.484805:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.484821:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.484847:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.484880:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.484893:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 15 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518205.484907:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522693632:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518205.484993:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518205.494838:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.494931:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522693632:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518205.494961:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518205.497755:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501638016 00000100:00100000:1.0:1789518205.497771:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501638016 00010000:00010000:0.0:1789518205.498715:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 16 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518205.498837:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789518205.498847:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+16:2388:x1876445501638016:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518205.498862:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518205.498869:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 16 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.498883:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 16 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.498904:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd6794231482b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566192 expref: 16 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.498936:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:0.0:1789518205.498941:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.498950:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.498957:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.498995:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518205.499052:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+15:2388:x1876445501638016:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 206us (4224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518205.499059:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00010000:00010000:1.0:1789518205.501498:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501514:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501556:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501564:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501571:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501577:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518205.501581:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501600:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501615:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:1.0:1789518205.501619:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789518205.501624:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.501630:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd6794231486a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518205.501714:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+14:11280:x1876445501637888:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 16983us (17197us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789518205.501724:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:1.0:1789518205.506453:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.506649:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501638144 00000100:00100000:3.0:1789518205.506659:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501638144 00000100:00100000:3.0:1789518205.506717:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789518205.506727:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501638144:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.506782:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.506803:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.506812:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518205.506817:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518205.506821:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.506862:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.506876:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 7 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.506890:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f996d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1876445522693760:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518205.506969:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518205.514578:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f996d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1876445522693760:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518205.514613:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518205.514780:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.514967:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501638272 00000100:00100000:2.0:1789518205.514976:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501638272 00010000:00010000:2.0:1789518205.515015:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518205.515055:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:2.0:1789518205.515064:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501638272:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518205.515079:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518205.515100:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515113:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515157:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2e4906f/0x8d0fd6794231485c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ae expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515182:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518205.515187:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518205.515192:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515202:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515227:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518205.515286:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501638272:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 222us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.515293:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00010000:00010000:2.0:1789518205.515321:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515329:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515348:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515357:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515372:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515379:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518205.515388:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515397:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515932:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.515945:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd67942314871 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518205.516015:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501638144:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 9289us (9568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.516024:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:1.0:1789518205.524573:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.524749:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501638528 00000100:00100000:3.0:1789518205.524760:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501638528 00000100:00100000:3.0:1789518205.524827:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 93 00000100:00100000:3.0:1789518205.524838:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+14:11280:x1876445501638528:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518205.524917:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.524935:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.524944:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.524992:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.525006:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 14 pid: 6515 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.525021:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522693888:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518205.525094:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518205.530676:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.530736:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522693888:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518205.530779:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518205.531073:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501638656 00000100:00100000:0.0:1789518205.531083:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501638656 00010000:00010000:0.0:1789518205.531120:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 15 pid: 6515 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518205.531833:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:0.0:1789518205.531849:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+15:2387:x1876445501638656:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518205.531868:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518205.531876:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 15 pid: 6515 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.531890:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 15 pid: 6515 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.531927:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd679423146b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566137 expref: 15 pid: 6515 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.531953:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:0.0:1789518205.531958:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.531967:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.531974:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.532045:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518205.532100:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+14:2387:x1876445501638656:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 257us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518205.532108:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00010000:00010000:3.0:1789518205.534086:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.534099:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.535547:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.535572:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.535596:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.535635:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.535649:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 14 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518205.535664:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522694016:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518205.535778:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd536c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518205.544053:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522694016:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518205.544087:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518205.546091:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518205.546166:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501638784 00000100:00100000:0.0:1789518205.546177:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501638784 00010000:00010000:0.0:1789518205.546215:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 15 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518205.546257:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:0.0:1789518205.546267:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+15:2387:x1876445501638784:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518205.546295:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518205.546302:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 15 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.546315:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 15 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.546348:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314839 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566199 expref: 15 pid: 6514 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.546373:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:0.0:1789518205.546378:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.546387:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.546395:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518205.546434:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518205.546512:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+14:2387:x1876445501638784:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 246us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518205.546520:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00010000:00010000:1.0:1789518205.547484:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.547497:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518205.547607:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789518205.547738:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1789518205.547788:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1789518205.547867:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522694144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518205.547933:0:8781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518205.547978:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518205.549057:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522694144 00000100:00100000:0.0:1789518205.549069:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522694144 00000100:00100000:0.0:1789518205.549123:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789518205.549133:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8781:x1876445522694144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789518205.549266:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8781:x1876445522694144:12345-0@lo:1000:mdt00_003.0 Request processed in 134us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518205.549284:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789518205.550284:0:8781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789518205.550293:0:8781:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e743f93f480, transno 4294967304 00000100:00100000:1.0:1789518205.550318:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522694144:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789518205.550515:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789518205.550591:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522694272:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518205.550640:0:8781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518205.550666:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518205.550684:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522694272 00000100:00100000:1.0:1789518205.550689:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522694272 00000100:00100000:1.0:1789518205.550725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789518205.550733:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8781:x1876445522694272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518205.550869:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8781:x1876445522694272:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (228us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789518205.550878:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789518205.550914:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522694272:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789518205.550951:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.550961:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.550968:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.550975:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033aca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518205.550981:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551015:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551031:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:1.0:1789518205.551034:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518205.551039:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551045:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd6794231487f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551074:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551080:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551084:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551089:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518205.551091:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551097:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551104:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:1.0:1789518205.551106:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518205.551108:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551123:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd679423147b4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551147:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551161:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 17 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551170:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551195:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 17 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518205.551208:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 17 pid: 8781 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518205.551219:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c63480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522694400:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518205.551283:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518205.564979:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.565053:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501638912 00000100:00100000:3.0:1789518205.565063:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501638912 00010000:00010000:3.0:1789518205.565103:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 18 pid: 8781 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518205.565146:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:3.0:1789518205.565157:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+18:2388:x1876445501638912:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518205.565172:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518205.565189:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 18 pid: 8781 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.565201:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 18 pid: 8781 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.565222:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518205.565239:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.565250:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.565257:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.565279:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518205.565349:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+18:2388:x1876445501638912:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 184us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.565357:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00010000:00010000:2.0:1789518205.567116:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423147d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856617d expref: 17 pid: 8781 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518205.567138:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c63480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522694400:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518205.567163:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567173:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567179:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567191:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567198:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567221:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567238:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518205.567243:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567251:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567266:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518205.567270:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518205.567274:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567281:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314886 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567293:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567299:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567304:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567310:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518205.567313:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567332:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567656:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:2.0:1789518205.567659:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518205.567663:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.567669:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314878 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518205.567925:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+16:11280:x1876445501638528:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 43087us (43361us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789518205.567936:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 93 00000020:00080000:2.0:1789518205.567942:0:8781:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789518205.574290:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.574381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501639168 00000100:00100000:2.0:1789518205.574392:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501639168 00000100:00100000:2.0:1789518205.574489:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789518205.574501:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+16:11280:x1876445501639168:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789518205.574796:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789518205.574828:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789518205.574859:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.574875:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.574886:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.574911:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.574918:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.574923:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.574942:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518205.575022:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+18:11280:x1876445501639168:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 522us (742us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789518205.575029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000020:00080000:2.0:1789518205.575034:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518205.575558:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518205.575568:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.575574:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518205.575578:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.575586:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.575613:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:3.0:1789518205.575616:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518205.575622:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.575628:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231488d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.575641:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518205.575643:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518205.575645:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518205.578103:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518205.578112:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518205.578130:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789518205.578136:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789518205.758152:0:14207:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518205.758162:0:14207:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518205.758194:0:14207:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789518205.758201:0:14207:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518205.949489:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522694528:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949568:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949618:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522695040:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949669:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522695552:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949716:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789518205.949722:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522694912:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949776:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949795:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522695424:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949816:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949834:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522695936:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949902:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522694784:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949923:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949940:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522695296:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949957:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.949973:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522695808:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.949994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.950011:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789518205.950016:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522694656:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.950045:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522695168:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950062:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.950078:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522695680:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518205.950117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522694528 00000100:00100000:2.0:1789518205.950125:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522694528 00000100:00100000:2.0:1789518205.950169:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789518205.950176:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522694528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950227:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522694528:12345-0@lo:400:kworker.0 Request processed in 51us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950234:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789518205.950266:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522694912 00000100:00100000:2.0:1789518205.950270:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522694912 00000100:00100000:2.0:1789518205.950288:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695424 00000100:00100000:2.0:1789518205.950290:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695424 00000100:00100000:2.0:1789518205.950310:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695296 00000100:00100000:2.0:1789518205.950319:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695296 00000100:00100000:2.0:1789518205.950333:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695808 00000100:00100000:2.0:1789518205.950335:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695808 00000100:00100000:2.0:1789518205.950347:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522694656 00000100:00100000:2.0:1789518205.950349:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522694656 00000100:00100000:2.0:1789518205.950358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695680 00000100:00100000:2.0:1789518205.950360:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695680 00000100:00100000:2.0:1789518205.950373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789518205.950378:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522694912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950408:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522694912:12345-0@lo:400:kworker.0 Request processed in 30us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789518205.950425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789518205.950431:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522695424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950456:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522695424:12345-0@lo:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950485:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789518205.950497:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789518205.950503:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522695296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950534:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522695296:12345-0@lo:400:kworker.0 Request processed in 31us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950540:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789518205.950550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789518205.950557:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522695808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950582:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522695808:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950588:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789518205.950607:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789518205.950613:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522694656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950642:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522694656:12345-0@lo:400:kworker.0 Request processed in 29us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950647:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789518205.950658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789518205.950664:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522695680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950687:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522695680:12345-0@lo:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950693:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789518205.950710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695040 00000100:00100000:2.0:1789518205.950714:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695040 00000100:00100000:2.0:1789518205.950734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522694784 00000100:00100000:2.0:1789518205.950748:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522694784 00000100:00100000:2.0:1789518205.950762:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789518205.950768:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522695040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950798:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522695040:12345-0@lo:400:kworker.0 Request processed in 31us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789518205.950814:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789518205.950820:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522694784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950844:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522694784:12345-0@lo:400:kworker.0 Request processed in 25us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950849:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789518205.950871:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695552 00000100:00100000:2.0:1789518205.950874:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695552 00000100:00100000:2.0:1789518205.950896:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695936 00000100:00100000:2.0:1789518205.950905:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695936 00000100:00100000:2.0:1789518205.950931:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522695168 00000100:00100000:2.0:1789518205.950934:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522695168 00000100:00100000:2.0:1789518205.950949:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789518205.950956:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522695552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.950988:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522695552:12345-0@lo:400:kworker.0 Request processed in 33us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.950994:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789518205.951004:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789518205.951009:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522695936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951032:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522695936:12345-0@lo:400:kworker.0 Request processed in 23us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.951036:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789518205.951045:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789518205.951051:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1876445522695168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951073:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1876445522695168:12345-0@lo:400:kworker.0 Request processed in 23us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.951079:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789518205.951117:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522694912:0@lo:400:kworker.0 00010000:00080000:2.0:1789518205.951130:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e741073bb80 x1876445522695424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518205.951140:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522695424:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951148:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522695936:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951155:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522694528:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951175:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522695040:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951184:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522695552:0@lo:400:kworker.0 00000100:00080000:2.0:1789518205.951213:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518205.951216:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518205.951219:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518205.951221:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518205.951235:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522694656:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951245:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522695168:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951254:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522695680:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522694784:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.951270:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522695296:0@lo:400:kworker.0 00010000:00080000:2.0:1789518205.951280:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303c3f800 x1876445522695808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518205.951289:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522695808:0@lo:400:kworker.0 00000100:00100000:2.0:1789518205.953177:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522696064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518205.953629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518205.953812:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522696064 00000100:00100000:3.0:1789518205.953823:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522696064 00000100:00100000:3.0:1789518205.953877:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789518205.953886:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522696064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518205.953913:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789518205.953999:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522696064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518205.954007:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789518205.954108:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518205.954584:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501639424 00000100:00100000:3.0:1789518205.954592:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501639424 00000100:00100000:3.0:1789518205.954635:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:3.0:1789518205.954645:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:11290:x1876445501639424:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518205.954666:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518205.954696:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.954834:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231489b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.954850:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231489b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.954862:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231489b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518205.954873:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789518205.954985:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661b5 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.955012:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231489b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661b5 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518205.955020:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518205.955023:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518205.955027:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d000, rc 0) 00000100:00100000:3.0:1789518205.955095:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+20:11290:x1876445501639424:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 452us (990us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789518205.955102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:2.0:1789518205.955690:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522696064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518205.960227:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518205.960681:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501639552 00000100:00100000:2.0:1789518205.960692:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501639552 00000100:00100000:2.0:1789518205.960857:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:2.0:1789518205.960869:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+20:11290:x1876445501639552:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789518205.960943:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.960968:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.960979:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.960994:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961000:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961006:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961077:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961084:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961091:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518205.961131:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961143:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961149:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961165:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961171:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518205.961175:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961181:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961192:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518205.961196:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518205.961200:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961205:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961216:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961221:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961226:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961231:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518205.961233:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961247:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961255:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e73010b5f00) 00010000:00010000:2.0:1789518205.961257:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518205.961260:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961265:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961278:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961284:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961290:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961295:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518205.961297:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961303:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961308:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5b00) 00010000:00010000:2.0:1789518205.961310:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518205.961312:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518205.961327:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518205.961413:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+20:11290:x1876445501639552:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 546us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518205.961422:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 95 00010000:00010000:0.0:1789518206.005795:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518206.037214:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.037317:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501639808 00000100:00100000:2.0:1789518206.037328:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501639808 00000100:00100000:2.0:1789518206.037438:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 96 00000100:00100000:2.0:1789518206.037449:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+20:11293:x1876445501639808:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518206.037499:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.037522:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037598:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037626:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037640:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037655:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037663:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037689:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037815:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037823:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037830:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518206.037839:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789518206.037919:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037927:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037934:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037940:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.037945:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037952:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037963:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518206.037966:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.037978:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.037985:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd679423148c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038000:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038006:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038012:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038017:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.038019:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038026:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038034:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e73010b5b00) 00010000:00010000:2.0:1789518206.038036:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.038039:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038045:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd679423148cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038085:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038105:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.038111:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:2.0:1789518206.038112:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518206.038114:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033acc00, rc 0) 00000100:00100000:2.0:1789518206.038173:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+22:11293:x1876445501639808:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 726us (971us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789518206.038180:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 96 00000100:00080000:0.0:1789518206.038333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518206.042831:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.043041:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501639936 00000100:00100000:3.0:1789518206.043050:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501639936 00000100:00100000:3.0:1789518206.043097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:3.0:1789518206.043106:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+22:11293:x1876445501639936:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:3.0:1789518206.043175:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043188:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043197:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043225:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043230:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043237:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043243:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518206.043247:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043256:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043267:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:3.0:1789518206.043270:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518206.043274:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.043280:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.043426:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+22:11293:x1876445501639936:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 320us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.043434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:3.0:1789518206.046673:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.047609:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501640192 00000100:00100000:2.0:1789518206.047623:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501640192 00000100:00100000:2.0:1789518206.047681:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789518206.047691:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+22:11293:x1876445501640192:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518206.047973:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+23:11293:x1876445501640192:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 282us (1310us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789518206.047981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789518206.093452:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.093690:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501640448 00000100:00100000:3.0:1789518206.093700:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501640448 00000100:00100000:3.0:1789518206.093772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:3.0:1789518206.093784:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+23:10821:x1876445501640448:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518206.093808:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518206.093831:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.093947:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.093961:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.093970:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.094003:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.094017:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 24 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.094052:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f997100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522696192:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518206.094152:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c256c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518206.099070:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f997100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522696192:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518206.099078:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00010000:00010000:3.0:1789518206.099104:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518206.099951:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501640576 00000100:00100000:0.0:1789518206.099962:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501640576 00010000:00010000:0.0:1789518206.100001:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518206.100034:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:0.0:1789518206.100044:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+25:2387:x1876445501640576:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518206.100060:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518206.100067:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.100079:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.100101:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423148d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661bc expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.100114:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:0.0:1789518206.100118:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.100125:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.100144:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.100166:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518206.100190:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.100198:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518206.100212:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+24:2387:x1876445501640576:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 169us (1134us total) trans 0 rc 0/0 00000004:00200000:3.0:1789518206.100216:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:0.0:1789518206.100219:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00010000:00010000:3.0:1789518206.100663:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423148e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.100688:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.100696:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:3.0:1789518206.100699:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518206.100702:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9dc00, rc 0) 00000100:00100000:3.0:1789518206.101439:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+24:10821:x1876445501640448:12345-192.168.202.43@tcp:101:bash.0 Request processed in 7654us (7993us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789518206.101449:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:1.0:1789518206.108091:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.108191:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501640704 00000100:00100000:2.0:1789518206.108203:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501640704 00000100:00100000:2.0:1789518206.108420:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:2.0:1789518206.108432:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+24:10821:x1876445501640704:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518206.108455:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.108636:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661ca expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.108672:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.108704:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.108717:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.108842:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd679423148fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ca expref: 26 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.108861:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ca expref: 25 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.108869:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:2.0:1789518206.108871:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518206.108875:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac000, rc 0) 00000100:00100000:2.0:1789518206.109071:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+25:10821:x1876445501640704:12345-192.168.202.43@tcp:101:bash.0 Request processed in 642us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.109079:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:0.0:1789518206.113278:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.113450:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501640960 00000100:00100000:2.0:1789518206.113633:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501640960 00000100:00100000:2.0:1789518206.113697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:2.0:1789518206.113706:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+25:10821:x1876445501640960:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:2.0:1789518206.113942:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.113960:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.113994:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518206.114037:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1789518206.114060:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c424de5b reply state 000000005677cd2a transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.114072:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.114078:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:2.0:1789518206.114081:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518206.114085:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789518206.114125:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1789518206.114336:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+29:10821:x1876445501640960:12345-192.168.202.43@tcp:36:bash.0 Request processed in 630us (1066us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789518206.114344:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 100 00000020:00080000:2.0:1789518206.114349:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789518206.119693:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.119840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501641088 00000100:00100000:3.0:1789518206.119862:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501641088 00000100:00100000:3.0:1789518206.119979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 101 00000100:00100000:3.0:1789518206.119991:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+29:10821:x1876445501641088:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518206.120016:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518206.120038:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314912 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661d1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.120111:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d1 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.120127:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d1 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.120146:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:3.0:1789518206.120150:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518206.120154:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c600, rc 0) 00000100:00100000:3.0:1789518206.120219:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+30:10821:x1876445501641088:12345-192.168.202.43@tcp:101:bash.0 Request processed in 230us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.120226:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 101 00000100:00100000:1.0:1789518206.127019:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.127726:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501641216 00000100:00100000:2.0:1789518206.127750:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501641216 00000100:00100000:2.0:1789518206.127854:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:2.0:1789518206.127865:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+6:10821:x1876445501641216:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518206.127883:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.127904:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661d8 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518206.127931:0:9982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa9e17c, atime: 0x6aa9e17a, ctime: 0x6aa9e17c, blocks: 0x8 00010000:00010000:2.0:1789518206.127953:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1789518206.127971:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518206.127981:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.127999:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.128013:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad400, rc 0) 00000100:00100000:2.0:1789518206.128083:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:10821:x1876445501641216:12345-192.168.202.43@tcp:101:bash.0 Request processed in 220us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.128089:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789518206.135258:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.136384:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501641344 00000100:00100000:2.0:1789518206.136409:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501641344 00002000:00010000:2.0:1789518206.136457:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1789518206.136493:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303c3f100 with x1876445501641344 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518206.136509:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303c3f100. 00000100:00100000:2.0:1789518206.136544:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:2.0:1789518206.136555:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501641344:12345-192.168.202.43@tcp:10:bash.0 00002000:00010000:2.0:1789518206.136859:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789518206.136863:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789518204 -> 1789518206 00002000:00010000:2.0:1789518206.136866:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789518202 -> 1789518202 00002000:00010000:2.0:1789518206.136868:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789518204 -> 1789518206 00002000:00010000:2.0:1789518206.136870:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789518206.136942:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501641344:12345-192.168.202.43@tcp:10:bash.0 Request processed in 388us (1699us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789518206.136949:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00002000:00010000:2.0:1789518206.136964:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1789518206.136967:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303c3f100 with x1876445501641344 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518206.136971:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303c3f100. 00000100:00100000:3.0:1789518206.266900:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.267451:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501641472 00000100:00100000:2.0:1789518206.267492:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501641472 00000100:00100000:2.0:1789518206.267548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 102 00000100:00100000:2.0:1789518206.267560:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+30:11307:x1876445501641472:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789518206.267632:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267649:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267663:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267679:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267686:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267693:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267770:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267780:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267787:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518206.267848:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267860:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267866:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267886:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267892:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033acc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.267896:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267903:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267915:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518206.267918:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.267923:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267929:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267943:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267949:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267962:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267967:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.267970:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267976:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267984:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e73010b5700) 00010000:00010000:2.0:1789518206.267987:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.267989:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.267995:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.268010:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.268017:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.268022:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.268026:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033adc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.268029:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.268045:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.268053:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:2.0:1789518206.268056:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.268059:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.268064:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231492e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518206.268146:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+30:11307:x1876445501641472:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 588us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.268153:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 102 00000100:00100000:1.0:1789518206.328853:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.329033:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501641728 00000100:00100000:2.0:1789518206.329044:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501641728 00000100:00100000:2.0:1789518206.329106:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 103 00000100:00100000:2.0:1789518206.329116:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+30:11310:x1876445501641728:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518206.329149:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.329173:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314935 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661df expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329263:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329279:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329292:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329323:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329331:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329338:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329671:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd6794231494a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329682:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd6794231494a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329690:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd6794231494a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518206.329702:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789518206.329802:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329809:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329816:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329821:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.329825:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329842:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329854:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518206.329857:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.329862:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329869:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231493c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329883:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329888:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329893:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329898:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033acc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.329901:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329906:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329913:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e73010b5700) 00010000:00010000:2.0:1789518206.329915:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.329918:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329934:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329980:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314935 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661df expref: 33 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.329993:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd6794231494a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661df expref: 32 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.330000:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:2.0:1789518206.330004:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518206.330007:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac600, rc 0) 00000100:00100000:2.0:1789518206.330083:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+32:11310:x1876445501641728:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 968us (1243us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789518206.330090:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 103 00000100:00100000:1.0:1789518206.337957:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.338113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501641856 00000100:00100000:2.0:1789518206.338127:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501641856 00000100:00100000:2.0:1789518206.338201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:2.0:1789518206.338212:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+32:11310:x1876445501641856:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789518206.338301:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.338319:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.338339:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.338392:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.338416:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 32 pid: 6515 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518206.338431:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522696320:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518206.338660:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518206.343716:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.343899:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522696320:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518206.343933:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.344037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501642112 00000100:00100000:3.0:1789518206.344044:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501642112 00000100:00100000:3.0:1789518206.344106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:3.0:1789518206.344116:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+33:6160:x1876445501642112:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789518206.344623:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+34:6160:x1876445501642112:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 506us (916us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789518206.344632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:1.0:1789518206.350187:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.350635:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501642240 00000100:00100000:3.0:1789518206.350646:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501642240 00010000:00010000:3.0:1789518206.350691:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 34 pid: 6515 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.350915:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:3.0:1789518206.350927:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+34:2388:x1876445501642240:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518206.350955:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518206.350964:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 34 pid: 6515 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.350978:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 34 pid: 6515 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.351000:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd679423148ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661c3 expref: 34 pid: 6515 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.351033:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:3.0:1789518206.351039:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.351050:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.351058:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.351093:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518206.351166:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+33:2388:x1876445501642240:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 241us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.351181:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00010000:00010000:2.0:1789518206.353917:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.353934:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.353985:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.353993:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.354001:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.354007:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.354012:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.354042:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.354060:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:2.0:1789518206.354062:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518206.354067:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.354073:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518206.354174:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+32:11310:x1876445501641856:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 15959us (16223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.354183:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:1.0:1789518206.357991:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518206.358202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501642496 00000100:00100000:0.0:1789518206.358212:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501642496 00000100:00100000:0.0:1789518206.358272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:0.0:1789518206.358282:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+32:11310:x1876445501642496:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518206.359019:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+33:11310:x1876445501642496:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 732us (1033us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789518206.359028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:1.0:1789518206.456228:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522696448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518206.456320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518206.456515:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522696448 00000100:00100000:3.0:1789518206.456524:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522696448 00000100:00100000:3.0:1789518206.456575:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789518206.456584:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522696448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518206.456608:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789518206.456668:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522696448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.456675:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789518206.456863:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522696448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518206.484886:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.485018:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501642752 00000100:00100000:2.0:1789518206.485028:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501642752 00000100:00100000:2.0:1789518206.485101:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 105 00000100:00100000:2.0:1789518206.485111:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+33:11321:x1876445501642752:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:2.0:1789518206.485136:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.485157:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231495f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661e6 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.485962:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.485981:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.485993:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486026:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486034:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486041:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486157:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486166:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486173:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518206.486184:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789518206.486906:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486916:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486923:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486929:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033acc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.486933:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486953:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486966:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518206.486969:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.486974:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486981:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314966 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.486996:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487001:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487008:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487013:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518206.487016:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487021:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487028:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e73010b5700) 00010000:00010000:2.0:1789518206.487030:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518206.487033:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487049:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231496d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487099:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd6794231495f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661e6 expref: 36 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487113:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661e6 expref: 35 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.487120:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:2.0:1789518206.487122:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518206.487125:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033aca00, rc 0) 00000100:00100000:2.0:1789518206.487273:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+35:11321:x1876445501642752:12345-192.168.202.43@tcp:101:cat.0 Request processed in 2162us (2396us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789518206.487283:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 105 00000100:00100000:1.0:1789518206.497068:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.497197:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501643008 00000100:00100000:3.0:1789518206.497216:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501643008 00000100:00100000:3.0:1789518206.497295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:3.0:1789518206.497306:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+35:11321:x1876445501643008:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:3.0:1789518206.498219:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+36:11321:x1876445501643008:12345-192.168.202.43@tcp:35:cat.0 Request processed in 909us (1155us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789518206.498232:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:1.0:1789518206.545012:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518206.546237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501643264 00000100:00100000:0.0:1789518206.546258:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501643264 00000100:00100000:0.0:1789518206.546431:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 106 00000100:00100000:0.0:1789518206.546445:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+36:11322:x1876445501643264:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:0.0:1789518206.546545:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789518206.546593:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314912 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d1 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.546627:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661e6 expref: 35 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547022:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd6794231494a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661df expref: 34 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547036:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ca expref: 33 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547047:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:0.0:1789518206.547054:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518206.547095:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547112:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547124:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547143:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547150:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547157:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547266:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547275:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547290:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518206.547670:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789518206.547682:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374333217268ns, next at 375333213899ns, rc = 0 00010000:00010000:0.0:1789518206.547753:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547762:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547771:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547788:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547800:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.547807:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548275:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518206.548307:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548316:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548424:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548445:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518206.548450:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548459:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548513:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:0.0:1789518206.548516:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518206.548521:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548527:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314990 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548551:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548917:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548923:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548929:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518206.548932:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548939:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548964:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:0.0:1789518206.548966:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518206.548970:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.548975:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314982 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518206.548989:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bb2af6a reply state 00000000319d0a2a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.549002:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.549010:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7303359800) 00010000:00010000:0.0:1789518206.549012:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518206.549015:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518206.549356:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+34:11322:x1876445501643264:12345-192.168.202.43@tcp:36:rm.0 Request processed in 2908us (4478us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789518206.549442:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 106 00010000:00010000:1.0:1789518206.549577:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518206.549587:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518206.549595:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7200 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518206.549599:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518206.549606:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518206.549617:0:7454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:1.0:1789518206.549630:0:7454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518206.549635:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518206.549641:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314997 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518206.549668:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518206.549670:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518206.549672:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518206.602218:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.602333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501643520 00000100:00100000:3.0:1789518206.602349:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501643520 00000100:00100000:3.0:1789518206.602962:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 107 00000100:00100000:3.0:1789518206.602979:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+34:11328:x1876445501643520:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518206.603017:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518206.603046:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231499e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603217:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603248:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603260:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603272:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603277:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603281:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518206.603740:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789518206.603922:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603933:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603942:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603986:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.603994:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604002:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604014:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518206.604019:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604026:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604037:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518206.604039:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518206.604044:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604048:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd679423149a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518206.604073:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f66d6e9e reply state 00000000e44dcb7a transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604082:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604086:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7303359800) 00010000:00010000:3.0:1789518206.604098:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518206.604100:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518206.604129:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd6794231499e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604157:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.604171:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518206.604173:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518206.604175:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9da00, rc 0) 00000100:00100000:3.0:1789518206.604257:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+37:11328:x1876445501643520:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1283us (2059us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789518206.604264:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 107 00000100:00100000:3.0:1789518206.620115:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.620586:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501643648 00000100:00100000:2.0:1789518206.620600:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501643648 00000100:00100000:2.0:1789518206.620715:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:2.0:1789518206.620739:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501643648:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518206.620766:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.620795:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661f4 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518206.620830:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789518206.620858:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1789518206.620863:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518206.621146:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.621171:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.621188:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ace00, rc 0) 00000100:00100000:2.0:1789518206.621278:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501643648:12345-192.168.202.43@tcp:101:bash.0 Request processed in 552us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.621285:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00080000:0.0:1789518206.622305:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518206.628718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.628970:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501643776 00000100:00100000:3.0:1789518206.628985:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501643776 00000100:00100000:3.0:1789518206.629066:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:3.0:1789518206.629080:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+8:11328:x1876445501643776:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518206.629119:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518206.629145:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785661fb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.629194:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.629206:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518206.629212:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518206.629219:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.629270:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.629317:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.629337:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f997b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1876445522696576:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518206.630328:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e744172fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518206.632082:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f997b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1876445522696576:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518206.632243:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.632273:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9dc00, rc 0) 00000100:00100000:3.0:1789518206.632350:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+9:11328:x1876445501643776:12345-192.168.202.43@tcp:101:bash.0 Request processed in 3272us (3647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.632524:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:0.0:1789518206.637770:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.637961:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501643904 00000100:00100000:3.0:1789518206.637977:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501643904 00010000:00010000:3.0:1789518206.638044:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.638547:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:3.0:1789518206.638563:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501643904:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518206.638587:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518206.638621:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.638667:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.638700:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000463534f7/0x8d0fd679423149c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661f4 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.638726:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518206.638745:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518206.638757:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.638770:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.642860:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518206.642897:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1876445522696704:192.168.202.43@tcp:105: 00000100:00100000:2.0:1789518206.643044:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518206.650640:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518206.650760:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501644160 00000100:00100000:0.0:1789518206.650773:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501644160 00000100:00100000:0.0:1789518206.650867:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:0.0:1789518206.650881:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+37:11328:x1876445501644160:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:0.0:1789518206.651336:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+38:11328:x1876445501644160:12345-192.168.202.43@tcp:35:bash.0 Request processed in 457us (709us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789518206.651368:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:2.0:1789518206.651906:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1876445522696704:192.168.202.43@tcp:105: 00010000:00010000:2.0:1789518206.651937:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518206.652025:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501643904:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 13466us (14270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.652035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789518206.842457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.842647:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501644288 00000100:00100000:2.0:1789518206.842662:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501644288 00000100:00100000:2.0:1789518206.842846:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 108 00000100:00100000:2.0:1789518206.842860:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+38:11344:x1876445501644288:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518206.842897:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.842945:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423149cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566202 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.843037:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423149d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.843055:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423149d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.843070:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423149d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518206.843135:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789518206.843140:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518206.843165:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423149d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.843195:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423149cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566202 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.843525:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423149d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566202 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.843535:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518206.843539:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518206.843545:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033acc00, rc 0) 00000100:00100000:2.0:1789518206.843806:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+39:11344:x1876445501644288:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 947us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.843815:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 108 00000100:00100000:1.0:1789518206.855700:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.858750:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501644544 00000100:00100000:2.0:1789518206.858801:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501644544 00000100:00100000:2.0:1789518206.858979:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 109 00000100:00100000:2.0:1789518206.858994:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+39:11344:x1876445501644544:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518206.859024:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518206.859054:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423149dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566209 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.859220:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423149e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.859238:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423149e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.859253:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423149e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518206.859266:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789518206.859432:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423149dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566209 expref: 42 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.859456:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423149e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566209 expref: 41 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.859520:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518206.859524:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518206.859528:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad800, rc 0) 00000100:00100000:2.0:1789518206.859627:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+41:11344:x1876445501644544:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 629us (3946us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789518206.859635:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 109 00000100:00100000:1.0:1789518206.866599:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518206.866883:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.866971:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501644928 00000100:00100000:2.0:1789518206.866987:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501644928 00000100:00100000:2.0:1789518206.867077:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:2.0:1789518206.867090:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+41:2388:x1876445501644928:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518206.867111:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518206.867143:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd679423149e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566209 expref: 41 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.867168:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518206.867175:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518206.867259:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+40:2388:x1876445501644928:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 171us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.867267:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789518206.873857:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501644800 00000100:00100000:0.0:1789518206.873878:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501644800 00000100:00100000:0.0:1789518206.874005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 110 00000100:00100000:0.0:1789518206.874018:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+40:11344:x1876445501644800:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518206.874049:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518206.874075:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd679423149f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566210 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.874226:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd679423149f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.874246:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd679423149f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.874261:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd679423149f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518206.874275:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789518206.874593:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd679423149f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566210 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.874614:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd679423149f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566210 expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.874624:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518206.874627:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789518206.874632:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7000, rc 0) 00000100:00100000:0.0:1789518206.874863:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+42:11344:x1876445501644800:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 846us (8275us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789518206.874872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 110 00000100:00100000:1.0:1789518206.890213:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518206.890295:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501645056 00000100:00100000:2.0:1789518206.890303:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501645056 00000100:00100000:2.0:1789518206.890377:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:2.0:1789518206.890387:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501645056:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:2.0:1789518206.890433:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.890451:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518206.890458:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518206.890702:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518206.890707:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.890900:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.890911:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 8 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.890922:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f997b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9982:1876445522696832:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518206.891057:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e744172fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518206.894716:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518206.894777:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501645184 00000100:00100000:0.0:1789518206.894785:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501645184 00002000:00100000:0.0:1789518206.894833:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e743f9b1500 x1876445501645184/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:607/0 lens 504/0 e 0 to 0 dl 1789518217 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518206.894840:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e743f9b1500 with x1876445501645184 ext(0->8) 00010000:00010000:0.0:1789518206.894847:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 9 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.894859:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 9 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518206.894864:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e743f9b1500 00000100:00100000:0.0:1789518206.894888:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:0.0:1789518206.894894:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501645184:12345-192.168.202.43@tcp:4:lfs.0 00000100:00100000:3.0:1789518206.895854:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f997b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9982:1876445522696832:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518206.895884:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518206.895936:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+11:2387:x1876445501645184:12345-192.168.202.43@tcp:4:lfs.0 Request processed in 1040us (1224us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789518206.895945:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00002000:00100000:0.0:1789518206.895955:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e743f9b1500 x1876445501645184/t4294967303(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:607/0 lens 504/448 e 0 to 0 dl 1789518217 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518206.895963:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e743f9b1500 with x1876445501645184 ext(0->8) 00010000:00010000:0.0:1789518206.895970:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 11 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.895993:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 11 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518206.896001:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e743f9b1500 00000100:00100000:1.0:1789518206.903558:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518206.903626:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501645312 00000100:00100000:0.0:1789518206.903634:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501645312 00010000:00010000:0.0:1789518206.903669:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 11 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518206.903706:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:0.0:1789518206.903715:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74056c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+11:2388:x1876445501645312:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518206.903760:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789518206.903779:0:9516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789518206.903781:0:9516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789518206 00002000:00010000:0.0:1789518206.903783:0:9516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789518206 00002000:00010000:0.0:1789518206.903784:0:9516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789518206 00002000:00010000:0.0:1789518206.903785:0:9516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789518206.903790:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 11 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.903807:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 11 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.903825:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd679423149c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661fb expref: 11 pid: 8428 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.903870:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518206.903875:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518206.903881:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.903891:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.903920:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518206.903965:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74056c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+10:2388:x1876445501645312:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 252us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518206.903970:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00010000:00010000:3.0:1789518206.904494:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904506:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904528:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904536:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904544:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904548:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518206.904551:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904557:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904568:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.904644:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000075a6ec8/0x8d0fd67942314a07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.904753:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501645056:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 14367us (14547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.904762:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:1.0:1789518206.918156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518206.918266:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501645568 00000100:00100000:0.0:1789518206.918278:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501645568 00000100:00100000:0.0:1789518206.918344:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789518206.918354:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+42:11344:x1876445501645568:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:0.0:1789518206.918438:0:6517:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd679423149f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566210 expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518206.918701:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1789518206.918745:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789518206.919599:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1789518206.919641:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.919657:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.919672:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.919709:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.919724:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 46 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518206.919748:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1876445522696960:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518206.920132:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518206.931148:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1876445522696960:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518206.931180:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518206.933163:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.933265:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501645696 00000100:00100000:3.0:1789518206.933275:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501645696 00010000:00010000:3.0:1789518206.933315:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 47 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.933364:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:3.0:1789518206.933374:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+47:2387:x1876445501645696:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518206.933390:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518206.933402:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 47 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.933415:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 47 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.933438:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd679423149b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661ed expref: 47 pid: 6514 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.933497:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518206.933503:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.933526:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.933534:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.933557:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518206.933614:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+46:2387:x1876445501645696:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 241us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.933622:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00010000:00010000:0.0:1789518206.933739:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518206.933748:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518206.933872:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789518206.933972:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789518206.934079:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522697088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518206.934131:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518206.934170:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f256c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518206.934226:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522697088 00000100:00100000:2.0:1789518206.934233:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522697088 00000100:00100000:2.0:1789518206.934275:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789518206.934284:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6517:x1876445522697088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518206.934364:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6517:x1876445522697088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.934369:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789518206.934541:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522697088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518206.934633:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789518206.934660:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f997b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522697216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518206.934680:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518206.934692:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e744172f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518206.934994:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522697216 00000100:00100000:0.0:1789518206.935008:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522697216 00000100:00100000:0.0:1789518206.935043:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789518206.935051:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6517:x1876445522697216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518206.935159:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6517:x1876445522697216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (476us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789518206.935165:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789518206.935490:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f997b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522697216:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518206.935520:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789518206.935543:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.935550:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.935554:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.935558:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518206.935561:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.935572:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.935582:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518206.935584:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789518206.935587:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.935591:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314a0e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518206.935660:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789518206.935705:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789518206.935715:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374721250874ns, next at 375721248399ns, rc = 0 00000001:00080000:3.0:1789518206.935720:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789518206.935751:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518206.935754:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518206.935761:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd679423149f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566210 expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518206.935943:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+49:11344:x1876445501645568:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 17592us (17799us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789518206.935949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000020:00080000:3.0:1789518206.935952:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518206.942541:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.942768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501645824 00000100:00100000:3.0:1789518206.942779:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501645824 00000100:00100000:3.0:1789518206.942851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 111 00000100:00100000:3.0:1789518206.942864:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+49:11344:x1876445501645824:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518206.942908:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518206.942931:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314a15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566217 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.942995:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314a15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566217 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.943011:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314a15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566217 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518206.943031:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518206.943034:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518206.943039:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9da00, rc 0) 00000100:00100000:3.0:1789518206.943104:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+50:11344:x1876445501645824:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 243us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.943111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 111 00000100:00100000:1.0:1789518206.946781:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518206.947066:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501646080 00000100:00100000:3.0:1789518206.947077:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501646080 00000100:00100000:3.0:1789518206.947138:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:3.0:1789518206.947149:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+50:11344:x1876445501646080:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789518206.947389:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+51:11344:x1876445501646080:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 242us (616us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789518206.947404:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:2.0:1789518206.965773:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518206.965797:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522697344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518206.965874:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518206.965951:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522697344 00000100:00100000:2.0:1789518206.965959:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522697344 00000100:00100000:2.0:1789518206.966014:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789518206.966024:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522697344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518206.966058:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789518206.966107:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522697344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518206.966115:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789518206.966163:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522697344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518206.966493:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518206.966504:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522697472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518206.966535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518206.966587:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522697472 00000100:00100000:3.0:1789518206.966592:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522697472 00000100:00100000:3.0:1789518206.966618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789518206.966624:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522697472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518206.966643:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518206.966678:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522697472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518206.966684:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789518206.966714:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522697472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518206.967142:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518206.967153:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522697600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518206.967186:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518206.967281:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522697600 00000100:00100000:0.0:1789518206.967289:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522697600 00000100:00100000:0.0:1789518206.967338:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789518206.967346:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3639:x1876445522697600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518206.967363:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518206.967423:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3639:x1876445522697600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518206.967430:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789518206.967511:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522697600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518207.030515:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518207.076018:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.076280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501646208 00000100:00100000:2.0:1789518207.076290:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501646208 00000100:00100000:2.0:1789518207.076353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 112 00000100:00100000:2.0:1789518207.076379:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+51:11354:x1876445501646208:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789518207.076455:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076495:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076505:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076514:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076519:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076523:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076580:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076585:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076588:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518207.076627:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076636:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076647:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076651:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076655:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.076658:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076664:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076672:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518207.076674:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518207.076678:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076684:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076697:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076703:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076709:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076714:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ade00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.076723:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076739:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076748:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7303359800) 00010000:00010000:2.0:1789518207.076750:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518207.076753:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076759:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076769:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076775:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076780:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076786:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.076788:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076808:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076816:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.076818:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518207.076827:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.076833:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.076915:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+51:11354:x1876445501646208:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 536us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.076923:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 112 00000100:00100000:1.0:1789518207.131666:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.132250:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501646464 00000100:00100000:3.0:1789518207.132263:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501646464 00000100:00100000:3.0:1789518207.132334:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 113 00000100:00100000:3.0:1789518207.132346:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+51:11357:x1876445501646464:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518207.132372:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518207.132405:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856621e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132511:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132526:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132539:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132551:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132577:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132584:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132699:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314a46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132707:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132714:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518207.132724:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789518207.132814:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132822:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132829:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132835:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518207.132839:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132846:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132869:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518207.132872:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518207.132877:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132883:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314a38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132903:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132909:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132915:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132920:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9dc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518207.132923:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132929:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132936:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7303359800) 00010000:00010000:3.0:1789518207.132938:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518207.132941:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132944:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314a3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.132993:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856621e expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.133003:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856621e expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.133008:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.133009:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518207.133011:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:3.0:1789518207.133094:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+53:11357:x1876445501646464:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 750us (1435us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789518207.133101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 113 00000100:00100000:1.0:1789518207.144175:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.144279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501646592 00000100:00100000:2.0:1789518207.144290:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501646592 00000100:00100000:2.0:1789518207.144344:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:2.0:1789518207.144352:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+53:11357:x1876445501646592:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789518207.144412:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144429:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144443:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144505:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144513:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144521:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144527:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.144546:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144555:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144567:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.144571:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518207.144577:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.144583:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.144658:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+53:11357:x1876445501646592:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 306us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.144667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:1.0:1789518207.150512:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.150610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501646848 00000100:00100000:3.0:1789518207.150619:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501646848 00000100:00100000:3.0:1789518207.150671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:3.0:1789518207.150682:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+53:11357:x1876445501646848:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789518207.150943:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+54:11357:x1876445501646848:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 262us (487us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789518207.150951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:1.0:1789518207.291051:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.291135:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501647104 00000100:00100000:3.0:1789518207.291146:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501647104 00000100:00100000:3.0:1789518207.291206:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:3.0:1789518207.291218:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+54:11367:x1876445501647104:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518207.291244:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518207.291247:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518207.291289:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd679423149d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566202 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.291308:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518207.291313:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518207.291325:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314a5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566225 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.291446:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314a62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.291460:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.291518:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518207.291529:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789518207.291632:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314a5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566225 expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.291650:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314a62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566225 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.291656:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.291659:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518207.291661:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031e00, rc 0) 00000100:00100000:3.0:1789518207.291736:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+55:11367:x1876445501647104:12345-192.168.202.43@tcp:101:bash.0 Request processed in 510us (696us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789518207.291743:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:1.0:1789518207.306017:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518207.306072:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.306187:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501647360 00000100:00100000:0.0:1789518207.306198:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501647360 00000100:00100000:0.0:1789518207.306282:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789518207.306292:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+55:2388:x1876445501647360:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518207.306308:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518207.306333:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314a62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566225 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.306352:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518207.306357:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518207.306421:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+54:2388:x1876445501647360:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.306429:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:2.0:1789518207.306763:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501647232 00000100:00100000:2.0:1789518207.306769:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501647232 00000100:00100000:2.0:1789518207.306808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:2.0:1789518207.306816:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+54:11367:x1876445501647232:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518207.306835:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518207.306851:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856622c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.306882:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.306895:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.306917:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.307020:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.307052:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.307061:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.307063:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518207.307066:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ade00, rc 0) 00000100:00100000:2.0:1789518207.307116:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+55:11367:x1876445501647232:12345-192.168.202.43@tcp:101:bash.0 Request processed in 301us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.307123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:1.0:1789518207.309558:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.309644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501647616 00000100:00100000:3.0:1789518207.309655:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501647616 00000100:00100000:3.0:1789518207.309715:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:3.0:1789518207.309735:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+55:11367:x1876445501647616:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:3.0:1789518207.309791:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518207.309820:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314a46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856621e expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.309840:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.309845:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518207.310018:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.310038:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.310048:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518207.310086:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789518207.310109:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000573eef17 reply state 00000000fbb15bcf transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.310121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.310127:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.310129:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518207.310132:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518207.310225:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+57:11367:x1876445501647616:12345-192.168.202.43@tcp:36:bash.0 Request processed in 501us (674us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789518207.310243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 117 00000020:00080000:3.0:1789518207.310247:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789518207.316380:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.316737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501647744 00000100:00100000:2.0:1789518207.316749:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501647744 00000100:00100000:2.0:1789518207.316814:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:2.0:1789518207.316825:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+57:11367:x1876445501647744:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518207.316851:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518207.316871:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566233 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.317007:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.317022:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.317043:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518207.317078:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789518207.317082:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518207.317101:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.317130:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.317148:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.317156:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.317159:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518207.317163:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad800, rc 0) 00000100:00100000:2.0:1789518207.317228:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+58:11367:x1876445501647744:12345-192.168.202.43@tcp:101:bash.0 Request processed in 404us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.317235:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:1.0:1789518207.321334:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.321421:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501648000 00000100:00100000:3.0:1789518207.321431:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501648000 00000100:00100000:3.0:1789518207.321514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:3.0:1789518207.321525:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+58:11367:x1876445501648000:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:3.0:1789518207.321805:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+59:11367:x1876445501648000:12345-192.168.202.43@tcp:35:bash.0 Request processed in 281us (490us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789518207.321813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:1.0:1789518207.420345:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.420508:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501648128 00000100:00100000:2.0:1789518207.420519:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501648128 00000100:00100000:2.0:1789518207.420579:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:2.0:1789518207.420590:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+59:11373:x1876445501648128:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518207.420613:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518207.420634:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856623a expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.420719:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314a9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.420916:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314a9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.420927:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314a9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518207.420973:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789518207.420976:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518207.420995:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314a9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.421019:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856623a expref: 61 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.421037:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314a9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856623a expref: 60 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.421045:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518207.421048:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518207.421052:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033acc00, rc 0) 00000100:00100000:2.0:1789518207.421128:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+60:11373:x1876445501648128:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 540us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.421136:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:1.0:1789518207.434653:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.435194:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501648256 00000100:00100000:2.0:1789518207.435206:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501648256 00000100:00100000:2.0:1789518207.435284:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:2.0:1789518207.435946:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+60:11373:x1876445501648256:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518207.435969:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518207.435990:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314aa1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566241 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436050:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436063:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436075:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436087:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436095:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436102:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436172:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314ab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436191:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.436199:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518207.436262:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789518207.436267:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518207.442508:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442546:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442561:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442569:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442578:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442583:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.442588:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442595:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442611:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518207.442614:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518207.442620:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442626:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314aa8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442677:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442684:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442690:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442695:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.442698:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442705:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442713:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7303359800) 00010000:00010000:2.0:1789518207.442715:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518207.442718:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442738:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314aaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442822:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314aa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566241 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442839:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566241 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.442857:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.442859:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518207.442862:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac000, rc 0) 00000100:00100000:2.0:1789518207.442975:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+61:11373:x1876445501648256:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 7680us (8336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.442987:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:1.0:1789518207.449111:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518207.449672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.449757:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501648640 00000100:00100000:3.0:1789518207.449770:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501648640 00000100:00100000:3.0:1789518207.449840:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:3.0:1789518207.449852:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+61:2387:x1876445501648640:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518207.449868:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518207.449892:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac000/0x8d0fd67942314ab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566241 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.449911:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.449917:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518207.449976:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+60:2387:x1876445501648640:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518207.449984:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:2.0:1789518207.451265:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501648512 00000100:00100000:2.0:1789518207.451277:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501648512 00000100:00100000:3.0:1789518207.454130:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:3.0:1789518207.454145:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+60:11373:x1876445501648512:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518207.454183:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518207.454204:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314abd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566248 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.454327:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.454342:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.454353:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.454389:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.454403:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 61 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.454418:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f997480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522697728:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518207.454589:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518207.473590:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.473771:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501648768 00000100:00100000:2.0:1789518207.473782:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501648768 00010000:00010000:2.0:1789518207.473828:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 62 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.473842:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f997480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522697728:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518207.473868:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.473876:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:2.0:1789518207.473889:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+62:2388:x1876445501648768:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518207.473905:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518207.473912:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 62 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.473926:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 62 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.473952:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314a8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566233 expref: 62 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.473971:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.473994:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.474008:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.474016:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.474047:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518207.474086:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.474094:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.474118:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+61:2388:x1876445501648768:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 232us (537us total) trans 0 rc 0/0 00000004:00200000:3.0:1789518207.474124:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:2.0:1789518207.474129:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00010000:00010000:3.0:1789518207.474300:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314abd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 62 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.474354:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 61 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.474364:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.474367:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518207.474370:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c200, rc 0) 00000100:00100000:3.0:1789518207.474415:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+61:11373:x1876445501648512:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 20272us (25312us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789518207.474424:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:1.0:1789518207.481907:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.482011:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501649024 00000100:00100000:3.0:1789518207.482022:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501649024 00000100:00100000:3.0:1789518207.482090:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:3.0:1789518207.482101:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+61:11373:x1876445501649024:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:3.0:1789518207.482117:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518207.482158:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314a15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566217 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.482196:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.482202:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518207.482289:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+60:11373:x1876445501649024:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 188us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518207.482298:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789518207.484369:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.484441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501649152 00000100:00100000:0.0:1789518207.484452:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501649152 00000100:00100000:0.0:1789518207.484526:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:0.0:1789518207.484536:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+60:11373:x1876445501649152:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:0.0:1789518207.484644:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.484661:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.484673:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518207.484776:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789518207.484863:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+60:11373:x1876445501649152:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 328us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.484870:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:2.0:1789518207.494846:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.494989:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501649280 00000100:00100000:0.0:1789518207.495001:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501649280 00000100:00100000:0.0:1789518207.495083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:0.0:1789518207.495094:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+60:11373:x1876445501649280:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518207.495125:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518207.495150:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856624f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.495216:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.495229:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.495263:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.495278:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.495549:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518207.495553:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518207.495559:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.495569:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7800, rc 0) 00000100:00100000:0.0:1789518207.495638:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+61:11373:x1876445501649280:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 546us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.495646:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 123 00000040:00080000:1.0:1789518207.605762:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518207.605772:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518207.605815:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789518207.605825:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789518207.605979:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522697856:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518207.606106:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023913c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518207.610927:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522697856:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518207.614366:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.614508:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501649408 00000100:00100000:0.0:1789518207.614519:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501649408 00000100:00100000:0.0:1789518207.614584:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:0.0:1789518207.614596:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+61:11374:x1876445501649408:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518207.614629:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518207.614777:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+61:11374:x1876445501649408:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 181us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.614785:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:2.0:1789518207.619280:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.619379:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501649536 00000100:00100000:3.0:1789518207.619398:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501649536 00000100:00100000:3.0:1789518207.619458:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:3.0:1789518207.619507:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+61:11374:x1876445501649536:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518207.619577:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619593:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619604:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619616:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619622:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619628:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619649:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619656:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619662:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518207.619706:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789518207.619734:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518207.619748:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619759:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619765:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619771:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619777:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518207.619781:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619788:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619799:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:3.0:1789518207.619802:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518207.619807:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619813:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314ae0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619838:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619845:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619861:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619866:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9dc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518207.619869:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619876:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619884:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8e7435d04900) 00010000:00010000:3.0:1789518207.619886:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518207.619889:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619894:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314ae7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619911:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619917:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619923:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619928:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518207.619930:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619946:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619955:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.619957:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518207.619960:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.619966:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314aee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.620030:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+61:11374:x1876445501649536:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 524us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518207.620039:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:3.0:1789518207.625112:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.625531:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501649792 00000100:00100000:2.0:1789518207.625542:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501649792 00000100:00100000:2.0:1789518207.625606:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:2.0:1789518207.625617:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+61:11374:x1876445501649792:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518207.625639:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518207.625659:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314af5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566256 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625777:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625793:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625805:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518207.625831:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789518207.625910:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625918:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625925:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625933:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.625937:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625944:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625958:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.625961:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518207.625966:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.625973:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314afc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.626013:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314af5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566256 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.626023:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:2.0:1789518207.626026:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518207.626037:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314af5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566256 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.626047:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad800, rc 0) 00000100:00100000:2.0:1789518207.626108:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+62:11374:x1876445501649792:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 494us (1007us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789518207.626116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:1.0:1789518207.630841:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.630925:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501649920 00000100:00100000:0.0:1789518207.630937:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501649920 00000100:00100000:0.0:1789518207.631004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 127 00000100:00100000:0.0:1789518207.631029:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+62:11374:x1876445501649920:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518207.631063:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518207.631179:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+62:11374:x1876445501649920:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 153us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.631187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 127 00000100:00100000:1.0:1789518207.638564:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.638714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501650176 00000100:00100000:0.0:1789518207.638736:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501650176 00000100:00100000:0.0:1789518207.638804:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 128 00000100:00100000:0.0:1789518207.638816:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+62:11374:x1876445501650176:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518207.638849:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518207.638852:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518207.638884:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314a9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856623a expref: 62 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.638905:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:0.0:1789518207.638910:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518207.638923:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314b0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856625d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518207.639314:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789518207.639542:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.639557:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.639569:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.639649:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314b0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856625d expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.639664:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856625d expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.639671:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518207.639674:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518207.639676:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6600, rc 0) 00000100:00100000:0.0:1789518207.639755:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+63:11374:x1876445501650176:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 940us (1202us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789518207.639762:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 128 00000100:00100000:1.0:1789518207.646601:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.646673:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501650432 00000100:00100000:0.0:1789518207.646685:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501650432 00000100:00100000:0.0:1789518207.646757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:0.0:1789518207.646768:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+63:11374:x1876445501650432:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518207.646827:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518207.646870:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856625d expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.646888:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518207.646900:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518207.646919:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.646933:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.646958:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647016:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647024:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647032:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647081:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647089:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647096:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647102:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.647107:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647114:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647123:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:0.0:1789518207.647126:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518207.647130:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647143:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b1f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647152:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647158:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647164:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647170:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.647173:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647179:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647187:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe89c2e10 (ffff8e7303359500) 00010000:00010000:0.0:1789518207.647189:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518207.647595:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.647604:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b26 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe89c2e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518207.647774:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+62:11374:x1876445501650432:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 1006us (1180us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518207.647783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:1.0:1789518207.650992:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.654895:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501650560 00000100:00100000:0.0:1789518207.654910:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501650560 00000100:00100000:0.0:1789518207.654981:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:0.0:1789518207.654991:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+62:11374:x1876445501650560:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518207.655012:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518207.655033:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566264 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.655067:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.655080:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.655091:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.655218:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314b2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.655236:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.655244:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:0.0:1789518207.655247:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518207.655250:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7600, rc 0) 00000100:00100000:0.0:1789518207.655310:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+63:11374:x1876445501650560:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 321us (4328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.655317:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:1.0:1789518207.660145:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.662335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501650816 00000100:00100000:0.0:1789518207.662350:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501650816 00000100:00100000:1.0:1789518207.662554:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:1.0:1789518207.662563:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+63:11374:x1876445501650816:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518207.662646:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.662716:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.662737:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518207.662991:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1789518207.663002:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375448537281ns, next at 376448533975ns, rc = 0 00000004:00010000:1.0:1789518207.663047:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000077aa065 reply state 00000000b95b3675 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.663059:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.663067:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:1.0:1789518207.663070:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789518207.663073:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518207.663289:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+65:11374:x1876445501650816:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 725us (3152us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789518207.663297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:1.0:1789518207.666395:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.666559:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501650944 00000100:00100000:0.0:1789518207.666569:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501650944 00000100:00100000:0.0:1789518207.666690:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 132 00000100:00100000:0.0:1789518207.666701:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+65:11374:x1876445501650944:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518207.666739:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518207.666760:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856626b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.666816:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.666838:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.666856:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:0.0:1789518207.666859:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518207.666863:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6600, rc 0) 00000100:00100000:0.0:1789518207.666919:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+66:11374:x1876445501650944:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 221us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.666926:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 132 00000100:00100000:1.0:1789518207.669986:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.670097:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501651072 00000100:00100000:3.0:1789518207.670109:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501651072 00000100:00100000:3.0:1789518207.670190:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789518207.670201:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b59ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501651072:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789518207.670420:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b59ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501651072:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 221us (442us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789518207.670428:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00080000:3.0:1789518207.670608:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518207.675826:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.676049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501651328 00000100:00100000:3.0:1789518207.676061:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501651328 00000100:00100000:3.0:1789518207.676298:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:3.0:1789518207.676308:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+66:11374:x1876445501651328:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518207.684203:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+67:11374:x1876445501651328:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 7883us (8374us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789518207.684220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:3.0:1789518207.689880:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.689941:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501651584 00000100:00100000:2.0:1789518207.689952:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501651584 00000100:00100000:2.0:1789518207.690019:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:2.0:1789518207.690031:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+67:11374:x1876445501651584:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518207.690292:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+67:11374:x1876445501651584:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 263us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.690301:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:1.0:1789518207.693820:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.693901:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501651712 00000100:00100000:2.0:1789518207.693912:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501651712 00000100:00100000:2.0:1789518207.693973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:2.0:1789518207.693983:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+67:11374:x1876445501651712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518207.694012:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518207.694032:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314b49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566272 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.694098:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.694110:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.694134:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518207.694188:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518207.694204:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.694226:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942314b49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566272 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.694253:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566272 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.694261:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:2.0:1789518207.694264:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518207.694268:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ace00, rc 0) 00000100:00100000:2.0:1789518207.694320:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+68:11374:x1876445501651712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 338us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.694327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:3.0:1789518207.697572:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.697665:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501651840 00000100:00100000:0.0:1789518207.697675:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501651840 00000100:00100000:0.0:1789518207.697739:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:0.0:1789518207.697750:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501651840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518207.697768:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518207.697800:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566279 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518207.697823:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e17f, blocks: 0x0 00010000:00010000:0.0:1789518207.697841:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1789518207.697844:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518207.697851:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.697866:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.697876:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6800, rc 0) 00000100:00100000:0.0:1789518207.697937:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+10:2388:x1876445501651840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 189us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.697945:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:3.0:1789518207.700610:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.700660:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501652096 00000100:00100000:2.0:1789518207.700671:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501652096 00000100:00100000:2.0:1789518207.700743:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 135 00000100:00100000:2.0:1789518207.700753:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+68:11374:x1876445501652096:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518207.700853:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+68:11374:x1876445501652096:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.700860:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 135 00000100:00100000:1.0:1789518207.703190:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.703231:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501652224 00000100:00100000:3.0:1789518207.703241:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501652224 00000100:00100000:3.0:1789518207.703393:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:3.0:1789518207.703405:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+10:11374:x1876445501652224:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518207.703424:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518207.703442:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566280 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.703507:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.703517:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518207.703521:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518207.703527:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 11 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.703561:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.703575:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 11 pid: 8428 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.703598:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f995c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522697984:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518207.703659:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518207.707601:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f995c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522697984:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518207.707649:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 11 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.707669:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:2.0:1789518207.707732:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+11:11374:x1876445501652224:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 4319us (4536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.707741:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:3.0:1789518207.707875:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.708051:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501652352 00000100:00100000:2.0:1789518207.708058:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501652352 00010000:00010000:2.0:1789518207.708086:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 11 pid: 8428 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.708145:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:2.0:1789518207.708154:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+11:2387:x1876445501652352:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518207.708167:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518207.708184:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 11 pid: 8428 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.708196:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 11 pid: 8428 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.708217:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000629feb1f/0x8d0fd67942314b57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566279 expref: 11 pid: 8428 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.708241:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518207.708252:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518207.708259:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 10 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.708270:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 10 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.708301:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 10 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.708315:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1876445522698112:192.168.202.43@tcp:105: 00000100:00100000:2.0:1789518207.708374:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518207.712808:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.712820:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1876445522698112:192.168.202.43@tcp:105: 00010000:00010000:2.0:1789518207.712843:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518207.712938:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501652480 00000100:00100000:0.0:1789518207.712954:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501652480 00002000:00100000:0.0:1789518207.713004:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8e7435f71880 x1876445501652480/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:608/0 lens 504/0 e 0 to 0 dl 1789518218 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518207.713015:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7435f71880 with x1876445501652480 ext(0->12) 00002000:00010000:0.0:1789518207.713020:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7435f71880 00000100:00100000:0.0:1789518207.713056:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:0.0:1789518207.713066:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+11:2388:x1876445501652480:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518207.714163:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+13:2387:x1876445501652352:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 6005us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.714174:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:0.0:1789518207.714306:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+12:2388:x1876445501652480:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 1241us (1509us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789518207.714574:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00002000:00100000:0.0:1789518207.714584:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8e7435f71880 x1876445501652480/t4294967309(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:608/0 lens 504/448 e 0 to 0 dl 1789518218 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518207.714593:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7435f71880 with x1876445501652480 ext(0->12) 00002000:00010000:0.0:1789518207.714598:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7435f71880 00000100:00100000:2.0:1789518207.717272:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.717367:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501652608 00000100:00100000:0.0:1789518207.717377:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501652608 00000100:00100000:0.0:1789518207.717659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00100000:0.0:1789518207.717671:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+68:11374:x1876445501652608:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789518207.720808:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1789518207.720834:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789518207.720877:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789518207.720892:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e744172f900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789518207.720897:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e743b232600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e744172fa80 00000020:00080000:1.0:1789518207.720908:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7435fb7000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e740ddbe600 00000004:00080000:1.0:1789518207.720938:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789518207.720962:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7302391d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789518207.720965:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e743b7cd500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7302391c00 00000020:00080000:1.0:1789518207.720967:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e743b7cd400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7302863600 00000100:00100000:1.0:1789518207.721064:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518207.721082:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522698240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518207.721145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789518207.721247:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789518207.721308:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789518207.721452:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e740480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522698496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518207.721504:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518207.721537:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522698240 00000100:00100000:3.0:1789518207.721545:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522698240 00000100:00100000:3.0:1789518207.721589:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522698496 00000100:00100000:3.0:1789518207.721593:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522698496 00000100:00100000:3.0:1789518207.721613:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518207.721621:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1876445522698240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789518207.721644:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1789518207.721673:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa9e17e, atime: 0x6aa9e17e, ctime: 0x6aa9e17e, blocks: 0x8 00010000:00010000:3.0:1789518207.721680:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.721695:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1789518207.721700:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518207.721706:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.721732:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.721743:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.721759:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.721776:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518207.721886:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3638:x1876445522698240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 265us (740us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789518207.721893:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518207.721908:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518207.721914:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522698496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789518207.721987:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789518207.721991:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789518207 00002000:00010000:3.0:1789518207.721994:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518207.721996:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789518207 -> 1789518207 00002000:00010000:3.0:1789518207.721999:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789518207.722027:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1876445522698496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (522us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789518207.722033:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789518207.722051:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518207.722057:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722066:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518207.722070:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722089:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722105:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722111:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d140116c/0x8d0fd67942314b65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722129:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518207.722130:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518207.722132:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518207.722146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518207.722149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789518207.722177:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e740480d500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789518207.722183:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e740480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522698496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518207.722253:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518207.722264:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522698368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789518207.722293:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518207.722439:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522698368 00000100:00100000:3.0:1789518207.722444:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522698368 00000004:00080000:1.0:1789518207.722550:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7435f71f80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789518207.722557:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522698240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518207.722636:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789518207.722644:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522698368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518207.722657:0:9982:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1789518207.722669:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722684:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 11 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722703:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789518207.722707:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518207.722711:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722751:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 11 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.722764:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 11 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.722776:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522698624:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518207.722832:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393f00 going to sleep for 11 seconds 00010000:00010000:0.0:1789518207.723325:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723335:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723342:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723347:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.723352:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723359:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723371:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:0.0:1789518207.723374:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518207.723396:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723404:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314863 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723425:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723432:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723438:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723443:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.723446:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723452:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723459:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8e73010b5f00) 00010000:00010000:0.0:1789518207.723481:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518207.723486:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723492:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac400/0x8d0fd6794231490b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723507:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723513:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723525:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723530:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7a00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.723533:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723539:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723547:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7303359800) 00010000:00010000:0.0:1789518207.723549:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518207.723552:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723557:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314989 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723567:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723573:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723578:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723584:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.723587:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723602:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723611:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7303359800) 00010000:00010000:0.0:1789518207.723613:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518207.723616:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723622:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd679423149ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723644:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723651:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723656:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723661:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.723664:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723670:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723678:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518207.723680:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518207.723683:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723709:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314a7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723734:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723741:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723747:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723751:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518207.723755:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723761:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723768:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:0.0:1789518207.723770:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789518207.723773:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.723779:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314b3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518207.723888:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+16:11374:x1876445501652608:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 6218us (6622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.723898:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00100000:2.0:1789518207.726969:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.727060:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522698624:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518207.727091:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518207.727650:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501652736 00000100:00100000:0.0:1789518207.727658:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501652736 00010000:00010000:0.0:1789518207.727696:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 12 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518207.729907:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:1.0:1789518207.729930:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741130a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+12:2388:x1876445501652736:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518207.729951:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518207.729961:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 12 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.729979:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 12 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.730002:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f562f885/0x8d0fd67942314919 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661d8 expref: 12 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.730036:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518207.730040:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518207.730046:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.730055:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.730093:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518207.730143:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.730154:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.730164:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.730179:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.730203:0:9982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518207.730328:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741130a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+11:2388:x1876445501652736:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 407us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518207.730337:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:3.0:1789518207.730393:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3637:x1876445522698368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7748us (8098us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789518207.730400:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:3.0:1789518207.730443:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e743f995c00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789518207.730449:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522698368:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789518207.730745:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518207.730753:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.730769:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518207.730774:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.730784:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.730796:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.730802:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314b6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.730816:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518207.730817:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518207.730818:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518207.731089:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.731150:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501652864 00000100:00100000:3.0:1789518207.731157:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501652864 00000100:00100000:3.0:1789518207.731200:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:3.0:1789518207.731208:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+11:2388:x1876445501652864:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789518207.733305:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789518207.733325:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789518207.733671:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501652864:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 2459us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518207.733683:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:0.0:1789518207.736335:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.736441:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501653120 00000100:00100000:2.0:1789518207.736450:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501653120 00000100:00100000:2.0:1789518207.736636:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 137 00000100:00100000:2.0:1789518207.736645:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+16:11374:x1876445501653120:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518207.736687:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518207.736708:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566272 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.736755:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:2.0:1789518207.736759:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518207.736788:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.736798:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.736805:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518207.736910:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7b66cf0 reply state 00000000c3e271a5 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.736920:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.736924:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:2.0:1789518207.736925:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518207.736927:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518207.737013:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+17:11374:x1876445501653120:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 369us (695us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789518207.737020:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 137 00000100:00100000:2.0:1789518207.754204:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.754828:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501653248 00000100:00100000:3.0:1789518207.754840:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501653248 00000100:00100000:3.0:1789518207.754903:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:3.0:1789518207.754913:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501653248:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789518207.755299:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789518207.755303:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789518207 -> 1789518207 00002000:00010000:3.0:1789518207.755305:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789518206 00002000:00010000:3.0:1789518207.755307:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789518207 -> 1789518207 00002000:00010000:3.0:1789518207.755322:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789518207.755397:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501653248:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 484us (1203us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789518207.755405:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:1.0:1789518207.760054:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.760194:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501653504 00000100:00100000:2.0:1789518207.760204:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501653504 00000100:00100000:2.0:1789518207.760260:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 138 00000100:00100000:2.0:1789518207.760270:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+17:11374:x1876445501653504:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518207.760359:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.760378:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.760388:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.760424:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.760437:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 17 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.760451:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522698752:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518207.760579:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518207.771160:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.771268:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501653632 00000100:00100000:3.0:1789518207.771277:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501653632 00010000:00010000:3.0:1789518207.771317:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 18 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.771363:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:3.0:1789518207.771372:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+18:2387:x1876445501653632:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518207.771386:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518207.771393:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 18 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.771407:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 18 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.771433:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:3.0:1789518207.771439:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.771448:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.771455:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.771514:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518207.771572:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+18:2387:x1876445501653632:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 201us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518207.771579:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00010000:00010000:2.0:1789518207.771680:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314b34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566264 expref: 17 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.771695:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522698752:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518207.771715:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771735:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771741:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771783:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771790:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771796:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771802:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.771806:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771814:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771824:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:2.0:1789518207.771826:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789518207.771830:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.771836:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314b7a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.771871:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+16:11374:x1876445501653504:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 11604us (11830us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789518207.771878:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 138 00000100:00100000:3.0:1789518207.775335:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.775492:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501653760 00000100:00100000:2.0:1789518207.775503:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501653760 00000100:00100000:2.0:1789518207.775561:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:2.0:1789518207.775585:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501653760:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518207.775630:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.775649:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.775658:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518207.775663:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518207.775668:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.775704:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 7 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.775717:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 7 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.775740:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522698880:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518207.775818:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518207.779801:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522698880:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518207.779836:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.780655:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.780769:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501653888 00000100:00100000:0.0:1789518207.780778:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501653888 00010000:00010000:0.0:1789518207.780816:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 8 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518207.780858:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:0.0:1789518207.780867:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501653888:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518207.780882:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518207.780905:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 8 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.780920:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 8 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.781072:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd8cb36/0x8d0fd67942314b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566280 expref: 8 pid: 9982 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.781162:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518207.781167:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518207.781173:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.781197:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.781269:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518207.781334:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501653888:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 467us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.781341:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00010000:00010000:3.0:1789518207.781894:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.781908:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.781935:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.782013:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.782022:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.782028:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033aca00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518207.782032:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.782041:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.782068:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.782077:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cfbb013/0x8d0fd67942314b81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.782216:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501653760:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 6633us (6891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518207.782224:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:3.0:1789518207.798647:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518207.801770:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501654144 00000100:00100000:1.0:1789518207.801784:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501654144 00000100:00100000:1.0:1789518207.801860:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 139 00000100:00100000:1.0:1789518207.801871:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+16:11374:x1876445501654144:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518207.801953:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.801972:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.801981:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.802033:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.802046:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 16 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518207.802061:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522699008:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518207.802166:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518207.809859:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.809974:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501654272 00000100:00100000:0.0:1789518207.809986:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501654272 00010000:00010000:0.0:1789518207.810026:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 17 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518207.810129:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:0.0:1789518207.810138:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+17:2387:x1876445501654272:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518207.810152:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518207.810159:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 17 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.810173:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 17 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.810195:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518207.810202:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.810233:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.810242:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.810249:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.810270:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518207.810333:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+17:2387:x1876445501654272:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 195us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.810340:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00010000:00010000:3.0:1789518207.810762:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314a77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856622c expref: 16 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.810781:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522699008:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518207.810801:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.810811:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.810817:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.810999:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.811012:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.811030:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.811060:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.811074:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 16 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.811088:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522699136:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518207.811160:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518207.818318:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518207.818607:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501654400 00000100:00100000:2.0:1789518207.818632:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501654400 00010000:00010000:2.0:1789518207.818673:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 17 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.818728:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:2.0:1789518207.818739:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+17:2387:x1876445501654400:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518207.818754:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518207.818761:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 17 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.818775:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 17 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.818801:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:2.0:1789518207.818807:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.818819:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.818829:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.818850:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518207.818916:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+17:2387:x1876445501654400:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 177us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.818923:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 76 00010000:00010000:3.0:1789518207.819770:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314b42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856626b expref: 16 pid: 6515 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.819791:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522699136:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518207.819816:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.819826:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.819832:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518207.820076:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789518207.820194:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1789518207.820231:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1789518207.820323:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1876445522699264:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518207.821324:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518207.821362:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518207.821426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522699264 00000100:00100000:0.0:1789518207.821437:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522699264 00000100:00100000:0.0:1789518207.821517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789518207.821530:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1876445522699264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518207.821672:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1876445522699264:12345-0@lo:1000:mdt00_001.0 Request processed in 146us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.821686:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789518207.821847:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789518207.821854:0:6514:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:3.0:1789518207.821872:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e740480d500, transno 4294967310 00000004:00080000:3.0:1789518207.821892:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e743f995c00, transno 4294967311 00000100:00100000:3.0:1789518207.821901:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1876445522699264:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789518207.822046:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1789518207.822107:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1876445522699392:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518207.822141:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518207.822172:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518207.822381:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522699392 00000100:00100000:0.0:1789518207.822460:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522699392 00000100:00100000:0.0:1789518207.822532:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789518207.822541:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1876445522699392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518207.822650:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1876445522699392:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (508us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789518207.822657:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789518207.822852:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6514:1876445522699392:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789518207.822890:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.822901:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.822909:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.822916:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9dc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518207.822922:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.822930:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.822949:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:1.0:1789518207.822959:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518207.822965:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.822972:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b8f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823012:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823019:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823025:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823031:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518207.823034:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823040:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823048:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:1.0:1789518207.823051:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518207.823059:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823071:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823081:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518207.823117:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518207.823131:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522699520:192.168.202.43@tcp:105: 00000100:00100000:1.0:1789518207.823246:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518207.828524:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522699520:192.168.202.43@tcp:105: 00010000:00010000:3.0:1789518207.828558:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828568:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942314ad2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828609:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828623:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828636:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828648:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828741:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828750:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828756:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518207.828761:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828768:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828783:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.828786:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518207.828790:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828796:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314b96 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828812:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828818:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828824:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828829:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518207.828838:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828845:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828853:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518207.828855:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518207.828858:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.828864:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314b88 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.829046:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+19:11374:x1876445501654144:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 27176us (30410us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789518207.829058:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 139 00000020:00080000:3.0:1789518207.829065:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789518207.829239:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.829622:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501654528 00000100:00100000:3.0:1789518207.829629:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501654528 00000100:00100000:3.0:1789518207.829676:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:3.0:1789518207.829685:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+19:11373:x1876445501654528:12345-192.168.202.43@tcp:49:lfs.0 00000100:00100000:3.0:1789518207.829791:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+19:11373:x1876445501654528:12345-192.168.202.43@tcp:49:lfs.0 Request processed in 107us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518207.829798:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00000040:00080000:0.0:1789518207.830328:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518207.830334:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518207.830894:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789518207.830907:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789518207.831664:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.831797:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501654784 00000100:00100000:0.0:1789518207.831806:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501654784 00000100:00100000:0.0:1789518207.831858:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:0.0:1789518207.831868:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+19:11373:x1876445501654784:12345-192.168.202.43@tcp:58:lfs.0 00000040:00080000:0.0:1789518207.832032:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789518207.832147:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+19:11373:x1876445501654784:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 280us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.832155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:2.0:1789518207.833970:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.834274:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501655040 00000100:00100000:3.0:1789518207.834287:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501655040 00000100:00100000:3.0:1789518207.834351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:3.0:1789518207.834361:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+19:11374:x1876445501655040:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789518207.834804:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518207.834840:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789518207.834876:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.834894:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.834907:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.834916:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.834922:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.834930:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.834945:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518207.835048:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+21:11374:x1876445501655040:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 688us (1087us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789518207.835057:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000020:00080000:3.0:1789518207.835061:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518207.835354:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518207.835369:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.835376:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9dc00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518207.835381:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.835401:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.835416:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:2.0:1789518207.835419:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518207.835424:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.835430:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314b9d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.835455:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518207.835457:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518207.835459:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518207.887453:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.887786:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501655168 00000100:00100000:3.0:1789518207.887811:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501655168 00000100:00100000:3.0:1789518207.887879:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:3.0:1789518207.887890:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+21:11376:x1876445501655168:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518207.887915:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518207.887950:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314ba4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566287 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888015:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888029:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888040:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888053:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888060:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888066:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888974:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888990:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 22 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.888999:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.889047:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 22 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518207.889074:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 22 pid: 8781 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518207.889088:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74317c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522699648:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518207.889860:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302393f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518207.900065:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74317c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522699648:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518207.900099:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518207.905421:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518207.905627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501655424 00000100:00100000:3.0:1789518207.905639:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501655424 00000100:00100000:3.0:1789518207.905702:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:3.0:1789518207.905712:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+23:6160:x1876445501655424:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789518207.905985:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+24:6160:x1876445501655424:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 273us (573us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789518207.905993:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:1.0:1789518207.908819:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518207.909041:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501655552 00000100:00100000:0.0:1789518207.909051:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501655552 00010000:00010000:0.0:1789518207.909089:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 24 pid: 8781 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518207.909133:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:0.0:1789518207.909143:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+24:2387:x1876445501655552:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518207.909157:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518207.909164:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 24 pid: 8781 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.909177:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 24 pid: 8781 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.909198:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942314ac4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566248 expref: 24 pid: 8781 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.909239:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518207.909245:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.909255:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.909263:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518207.909302:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518207.909364:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+23:2387:x1876445501655552:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 223us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518207.909372:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 77 00010000:00010000:2.0:1789518207.909519:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909528:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518207.909578:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789518207.909583:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518207.909603:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909623:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909633:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909639:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909647:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909653:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.909657:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909664:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909673:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:2.0:1789518207.909676:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518207.909680:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909686:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314bab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909707:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909713:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909736:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909741:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518207.909744:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909750:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909759:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8e7435d04900) 00010000:00010000:2.0:1789518207.909761:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518207.909764:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909770:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314bb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909803:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314ba4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566287 expref: 23 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909816:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566287 expref: 22 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518207.909823:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:2.0:1789518207.909825:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518207.909828:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9dc00, rc 0) 00000100:00100000:2.0:1789518207.909854:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+22:11376:x1876445501655168:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 21967us (22410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518207.909869:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 141 00010000:00010000:3.0:1789518208.055623:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789518208.334418:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789518208.334451:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:0.0:1789518208.885852:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518208.885860:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518208.885886:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789518208.885894:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518208.886032:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522699776:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518208.886519:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518208.893720:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522699776:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518208.903722:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518208.903919:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501655680 00000100:00100000:3.0:1789518208.903930:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501655680 00000100:00100000:3.0:1789518208.904007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:3.0:1789518208.904017:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+22:11387:x1876445501655680:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518208.904051:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518208.904170:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+22:11387:x1876445501655680:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 153us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518208.904189:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00080000:1.0:1789518208.904246:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518208.912269:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518208.916016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501655936 00000100:00100000:0.0:1789518208.916032:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501655936 00000100:00100000:0.0:1789518208.916111:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 143 00000100:00100000:0.0:1789518208.916122:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+22:11387:x1876445501655936:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518208.916164:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518208.916184:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314bc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856628e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.916293:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314bc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.916309:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.916323:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518208.916335:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789518208.916483:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314bc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856628e expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.916503:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856628e expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.916511:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518208.916513:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518208.916517:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6200, rc 0) 00000100:00100000:0.0:1789518208.916589:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+24:11387:x1876445501655936:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 468us (4329us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789518208.916597:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 143 00000100:00100000:1.0:1789518208.931366:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518208.931413:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518208.931635:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501656320 00000100:00100000:0.0:1789518208.931645:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501656320 00000100:00100000:0.0:1789518208.931705:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:0.0:1789518208.931741:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+24:2390:x1876445501656320:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518208.931757:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518208.931781:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314bc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856628e expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.931796:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518208.931801:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518208.931853:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+23:2390:x1876445501656320:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 115us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518208.931861:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:3.0:1789518208.931873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501656192 00000100:00100000:3.0:1789518208.931887:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501656192 00000100:00100000:3.0:1789518208.931955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 144 00000100:00100000:3.0:1789518208.931976:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+23:11387:x1876445501656192:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518208.932074:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.932094:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.932109:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.932943:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.932956:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.932963:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.932970:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518208.932975:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.932984:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.933016:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518208.933019:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518208.933025:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.933032:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ca00/0x8d0fd67942314bd5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518208.933751:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+24:11387:x1876445501656192:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 1709us (2329us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789518208.933766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 144 00000040:00080000:0.0:1789518208.933797:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518208.933806:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518208.934293:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789518208.934304:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789518208.936736:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518208.936808:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501656576 00000100:00100000:0.0:1789518208.936820:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501656576 00000100:00100000:0.0:1789518208.936884:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:0.0:1789518208.936895:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+24:11387:x1876445501656576:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518208.937134:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+25:11387:x1876445501656576:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 240us (407us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789518208.937143:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000040:00080000:2.0:1789518208.950127:0:14259:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518208.950137:0:14259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518208.950168:0:14259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789518208.950174:0:14259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789518209.081964:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518209.154595:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518209.154720:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501656832 00000100:00100000:0.0:1789518209.154736:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501656832 00000100:00100000:0.0:1789518209.154815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 145 00000100:00100000:0.0:1789518209.154829:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+25:11401:x1876445501656832:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518209.154867:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518209.154907:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314bdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566295 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518209.155139:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314be3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518209.155158:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314be3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518209.155175:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314be3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518209.155190:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789518209.155381:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314bdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566295 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518209.155415:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314be3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566295 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518209.155424:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:0.0:1789518209.155428:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789518209.155432:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7e00, rc 0) 00000100:00100000:0.0:1789518209.155543:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+27:11401:x1876445501656832:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 717us (962us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789518209.155552:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 145 00000100:00100000:3.0:1789518209.164676:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518209.164834:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501656960 00000100:00100000:1.0:1789518209.164848:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501656960 00000100:00100000:1.0:1789518209.164927:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 146 00000100:00100000:1.0:1789518209.164939:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74317c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:11401:x1876445501656960:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:1.0:1789518209.165147:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165590:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165610:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165678:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165686:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165695:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165702:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518209.165718:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165729:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165744:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:1.0:1789518209.165748:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518209.165755:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.165762:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314bf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518209.165867:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74317c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:11401:x1876445501656960:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 927us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518209.165877:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 146 00000100:00100000:2.0:1789518209.300841:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518209.300955:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657088 00000100:00100000:3.0:1789518209.300976:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657088 00000100:00080000:1.0:1789518209.301033:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518209.301155:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:3.0:1789518209.301180:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501657088:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:3.0:1789518209.301206:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518209.301231:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e5ccab1/0x8d0fd67942314bf8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856629c expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518209.301277:0:13804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa9e17f, atime: 0x6aa9e17e, ctime: 0x6aa9e17f, blocks: 0x8 00010000:00010000:3.0:1789518209.301308:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1789518209.301313:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518209.301324:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e5ccab1/0x8d0fd67942314bf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856629c expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518209.301346:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e5ccab1/0x8d0fd67942314bf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856629c expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518209.301394:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9ca00, rc 0) 00000100:00100000:3.0:1789518209.301508:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501657088:12345-192.168.202.43@tcp:101:cat.0 Request processed in 342us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518209.301516:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:2.0:1789518209.304723:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518209.304816:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657216 00000100:00100000:0.0:1789518209.304830:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657216 00002000:00100000:0.0:1789518209.304904:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8e743f980380 x1876445501657216/t0(0) o3->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:610/0 lens 488/0 e 0 to 0 dl 1789518220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518209.304917:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e743f980380 with x1876445501657216 ext(0->4095) 00002000:00010000:0.0:1789518209.304946:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e743f980380 00000100:00100000:0.0:1789518209.305021:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:0.0:1789518209.305033:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501657216:12345-192.168.202.43@tcp:3:cat.0 00000100:00100000:0.0:1789518209.305317:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501657216:12345-192.168.202.43@tcp:3:cat.0 Request processed in 285us (620us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518209.305326:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00002000:00100000:0.0:1789518209.305333:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8e743f980380 x1876445501657216/t0(0) o3->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:610/0 lens 488/4536 e 0 to 0 dl 1789518220 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518209.305342:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e743f980380 with x1876445501657216 ext(0->4095) 00002000:00010000:0.0:1789518209.305346:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e743f980380 00000100:00100000:3.0:1789518209.525874:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522699904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518209.525986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518209.526205:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522699904 00000100:00100000:1.0:1789518209.526218:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522699904 00000100:00100000:1.0:1789518209.526550:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789518209.526564:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522699904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789518209.526609:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789518209.526768:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518209.526822:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522699904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518209.527330:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522699904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 767us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518209.527340:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789518209.950688:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518209.950799:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518209.950831:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518209.950906:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657728 00000100:00100000:3.0:1789518209.950922:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657728 00000100:00100000:3.0:1789518209.951029:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:3.0:1789518209.951043:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501657728:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518209.951141:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501657728:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 101us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518209.951150:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00080000:1.0:1789518209.953208:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518209.963656:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518209.963694:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518209.969156:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657472 00000100:00100000:0.0:1789518209.969178:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657472 00000100:00100000:0.0:1789518209.969277:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657984 00000100:00100000:0.0:1789518209.969281:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657984 00000100:00080000:0.0:1789518209.969314:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518209.969354:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 300 00000100:00100000:0.0:1789518209.969379:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:2388:x1876445501657472:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518209.969509:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:2388:x1876445501657472:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 145us (18836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518209.969518:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 300 00000100:00100000:0.0:1789518209.969542:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 301 00000100:00100000:0.0:1789518209.969549:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501657984:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518209.969576:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501657984:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 28us (18744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518209.969583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 301 00000100:00100000:0.0:1789518209.969826:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657344 00000100:00100000:0.0:1789518209.969832:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657344 00000100:00100000:0.0:1789518209.969884:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 383 00000100:00100000:0.0:1789518209.969891:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501657344:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518209.969929:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740dd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501657344:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 38us (6289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518209.969936:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 383 00000100:00100000:2.0:1789518209.975525:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518209.975621:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518209.976004:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657856 00000100:00100000:2.0:1789518209.976018:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657856 00000100:00100000:2.0:1789518209.976087:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:2.0:1789518209.976098:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501657856:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518209.976198:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501657856:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 102us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518209.976207:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:3.0:1789518209.980918:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501657600 00000100:00100000:3.0:1789518209.980940:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501657600 00000100:00100000:3.0:1789518209.981091:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501658112 00000100:00100000:3.0:1789518209.981096:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501658112 00000100:00100000:3.0:1789518209.981131:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 302 00000100:00100000:3.0:1789518209.981143:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501657600:12345-192.168.202.43@tcp:400:kworker.0 00000100:00080000:2.0:1789518209.982349:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518209.982419:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 303 00000100:00100000:2.0:1789518209.982439:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501658112:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518209.982574:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501658112:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 145us (6953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518209.982583:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 303 00000100:00100000:3.0:1789518209.983777:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501657600:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 2627us (20071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518209.983791:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 302 00010000:00010000:2.0:1789518210.104017:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518211.062006:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522700416:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062081:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522700160:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062218:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522700672:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062246:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062268:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522701056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518211.062289:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062309:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522701696:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062349:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789518211.062355:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522700032:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062403:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522700544:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062426:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062442:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522701184:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062525:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522701568:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518211.062585:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701056 00000100:00100000:1.0:1789518211.062599:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701056 00000100:00100000:1.0:1789518211.062671:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789518211.062682:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522701056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518211.062738:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789518211.062784:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522701056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518211.062791:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789518211.062815:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700672 00000100:00100000:1.0:1789518211.062819:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700672 00000100:00100000:1.0:1789518211.062844:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701696 00000100:00100000:1.0:1789518211.062846:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701696 00000100:00100000:1.0:1789518211.062855:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701184 00000100:00100000:1.0:1789518211.062857:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701184 00000100:00100000:1.0:1789518211.062867:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701568 00000100:00100000:1.0:1789518211.062869:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701568 00000100:00100000:1.0:1789518211.062881:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789518211.062886:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522700672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062917:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522700672:12345-0@lo:400:kworker.0 Request processed in 31us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518211.062923:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789518211.062933:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789518211.062939:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522701696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.062960:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522701696:12345-0@lo:400:kworker.0 Request processed in 22us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518211.062965:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789518211.062974:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789518211.062979:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522701184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063002:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522701184:12345-0@lo:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518211.063015:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789518211.063025:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789518211.063030:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522701568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063053:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522701568:12345-0@lo:400:kworker.0 Request processed in 23us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518211.063058:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789518211.063074:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700032 00000100:00100000:1.0:1789518211.063077:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700032 00000100:00100000:1.0:1789518211.063097:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789518211.063102:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522700032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063128:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522700032:12345-0@lo:400:kworker.0 Request processed in 25us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518211.063133:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789518211.063157:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700544 00000100:00100000:1.0:1789518211.063160:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700544 00000100:00100000:1.0:1789518211.063179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789518211.063184:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522700544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063213:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522700544:12345-0@lo:400:kworker.0 Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518211.063218:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1789518211.063239:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518211.063242:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518211.063272:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522700032:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063282:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522700544:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063291:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522701184:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063307:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522701568:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063315:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789518211.063321:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1789518211.063338:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e743f93e680, transno 4294967302 00000004:00080000:1.0:1789518211.063348:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1789518211.063360:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7435f71f80, transno 4294967305 00000100:00100000:1.0:1789518211.063364:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522700672:0@lo:400:kworker.0 00000100:00100000:1.0:1789518211.063379:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522701056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518211.063388:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522701696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518211.063856:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700160 00000100:00100000:3.0:1789518211.063864:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700160 00000100:00100000:3.0:1789518211.063906:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789518211.063913:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522700160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518211.063962:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522700160:12345-0@lo:400:kworker.0 Request processed in 50us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518211.063969:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789518211.064009:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522700160:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064277:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518211.064311:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522700928:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064333:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518211.064354:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522701440:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518211.064389:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789518211.064396:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73036dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522700288:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518211.064436:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522700800:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518211.064489:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522701312:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518211.064552:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700288 00000100:00100000:2.0:1789518211.064556:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700288 00000100:00100000:2.0:1789518211.064602:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789518211.064609:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522700288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064774:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522700288:12345-0@lo:400:kworker.0 Request processed in 165us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518211.064783:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789518211.064803:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700416 00000100:00100000:2.0:1789518211.064807:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700416 00000100:00100000:2.0:1789518211.064830:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700928 00000100:00100000:2.0:1789518211.064833:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700928 00000100:00100000:2.0:1789518211.064854:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701440 00000100:00100000:2.0:1789518211.064856:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701440 00000100:00100000:2.0:1789518211.064868:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522700800 00000100:00100000:2.0:1789518211.064870:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522700800 00000100:00100000:2.0:1789518211.064884:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701312 00000100:00100000:2.0:1789518211.064886:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701312 00000100:00100000:2.0:1789518211.064901:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789518211.064906:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522700416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064936:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522700416:12345-0@lo:400:kworker.0 Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518211.064942:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789518211.064953:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789518211.064959:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522700928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.064984:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522700928:12345-0@lo:400:kworker.0 Request processed in 24us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518211.064990:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789518211.065001:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789518211.065006:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522701440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.065029:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522701440:12345-0@lo:400:kworker.0 Request processed in 23us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518211.065034:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789518211.065043:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789518211.065048:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522700800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.065068:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522700800:12345-0@lo:400:kworker.0 Request processed in 20us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518211.065082:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789518211.065093:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789518211.065098:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522701312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.065123:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522701312:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518211.065128:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:2.0:1789518211.065142:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518211.065145:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518211.065166:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522700288:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.065176:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522700800:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.065183:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522701312:0@lo:400:kworker.0 00010000:00080000:2.0:1789518211.065194:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f09180 x1876445522701440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518211.065204:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522701440:0@lo:400:kworker.0 00000100:00100000:2.0:1789518211.065213:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73036dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522700416:0@lo:400:kworker.0 00010000:00080000:2.0:1789518211.065221:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f09500 x1876445522700928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518211.065229:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522700928:0@lo:400:kworker.0 00010000:00010000:3.0:1789518211.125777:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518211.573893:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522701824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518211.573964:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518211.574169:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701824 00000100:00100000:0.0:1789518211.574179:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701824 00000100:00100000:0.0:1789518211.574235:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789518211.574245:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522701824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789518211.574266:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789518211.574322:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522701824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518211.574329:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789518211.574512:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522701824:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1789518212.027918:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518212.027933:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518212.027953:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789518212.027959:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518212.086298:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518212.086326:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522701952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518212.086406:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518212.086500:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522701952 00000100:00100000:0.0:1789518212.086507:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522701952 00000100:00100000:0.0:1789518212.086553:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789518212.086562:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522701952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518212.086594:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789518212.086641:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522701952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518212.086648:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789518212.086705:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522701952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518212.086909:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522702080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518212.086944:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518212.087089:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702080 00000100:00100000:0.0:1789518212.087094:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702080 00000100:00100000:0.0:1789518212.087129:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789518212.087138:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522702080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518212.087158:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518212.087196:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522702080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518212.087202:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789518212.087230:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522702080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518212.090359:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518212.090383:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522702208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518212.090449:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518212.090525:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702208 00000100:00100000:0.0:1789518212.090533:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702208 00000100:00100000:0.0:1789518212.090577:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789518212.090585:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522702208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518212.090629:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789518212.090677:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522702208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518212.090693:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789518212.090741:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522702208:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789518212.150114:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518212.411063:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1789518213.127160:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789518213.127175:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1789518213.129873:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1789518213.129910:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7302393d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789518213.129916:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7302356f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7302393180 00000020:00080000:3.0:1789518213.129919:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7302356500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7406dcda00 00000020:00080000:3.0:1789518213.129935:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1789518213.130616:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518213.130630:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518213.130648:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518213.130654:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ac600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518213.130659:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518213.130667:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518213.130694:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8e7303359500) 00010000:00010000:2.0:1789518213.130697:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518213.130702:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518213.130708:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314b73 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789518213.130740:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789518213.130809:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789518213.173713:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518213.751811:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518213.751977:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501658240 00000100:00100000:3.0:1789518213.751989:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501658240 00000100:00100000:3.0:1789518213.752059:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:3.0:1789518213.752070:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+13:11062:x1876445501658240:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789518213.752177:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+13:11062:x1876445501658240:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 Request processed in 108us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518213.752184:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00080000:2.0:1789518213.752297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518213.776325:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518213.776436:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501658368 00000100:00100000:1.0:1789518213.776446:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501658368 00000100:00100000:1.0:1789518213.776545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 148 00000100:00100000:1.0:1789518213.776557:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:11062:x1876445501658368:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518213.776659:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:11062:x1876445501658368:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518213.776675:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 148 00000100:00080000:2.0:1789518213.776781:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518213.779009:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518213.779194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501658624 00000100:00100000:0.0:1789518213.779203:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501658624 00000100:00100000:0.0:1789518213.779299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:0.0:1789518213.779310:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+13:11062:x1876445501658624:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518213.779585:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+14:11062:x1876445501658624:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 277us (583us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789518213.779593:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00010000:00010000:3.0:1789518214.197602:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518214.647006:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522702336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518214.647097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518214.647394:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702336 00000100:00100000:2.0:1789518214.647403:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702336 00000100:00100000:2.0:1789518214.647490:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789518214.647500:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522702336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518214.647548:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518214.647595:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522702336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518214.647601:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1789518214.647674:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518214.648189:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522702336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518215.066449:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518215.066536:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518215.066573:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518215.066599:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518215.066616:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518215.066637:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518215.066673:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518215.066721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501658880 00000100:00100000:3.0:1789518215.066730:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501658880 00000100:00100000:3.0:1789518215.066816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501659392 00000100:00100000:3.0:1789518215.066819:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501659392 00000100:00100000:3.0:1789518215.066834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501659008 00000100:00100000:3.0:1789518215.066837:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501659008 00000100:00100000:3.0:1789518215.066848:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501659520 00000100:00100000:3.0:1789518215.066851:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501659520 00000100:00100000:3.0:1789518215.066870:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 310 00000100:00100000:3.0:1789518215.066881:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+14:2387:x1876445501658880:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518215.066982:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+14:2387:x1876445501658880:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 103us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.066990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 310 00000100:00100000:3.0:1789518215.067008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 311 00000100:00100000:3.0:1789518215.067014:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501659392:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518215.067040:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501659392:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.067046:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 311 00000100:00100000:3.0:1789518215.067057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 312 00000100:00100000:3.0:1789518215.067079:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501659008:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518215.067105:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501659008:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.067111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 312 00000100:00100000:3.0:1789518215.067123:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 313 00000100:00100000:3.0:1789518215.067130:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501659520:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518215.067157:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501659520:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.067163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 313 00000100:00100000:3.0:1789518215.067199:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501659136 00000100:00100000:3.0:1789518215.067202:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501659136 00000100:00100000:3.0:1789518215.067236:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501659264 00000100:00100000:3.0:1789518215.067239:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501659264 00000100:00100000:3.0:1789518215.067259:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:3.0:1789518215.067265:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501659136:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518215.067291:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501659136:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.067298:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:3.0:1789518215.067308:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:3.0:1789518215.067313:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501659264:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518215.067339:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501659264:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.067345:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00080000:3.0:1789518215.067360:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518215.067370:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518215.067373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518215.067375:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518215.067740:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501658752 00000100:00100000:0.0:1789518215.067746:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501658752 00000100:00100000:0.0:1789518215.067787:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 385 00000100:00100000:0.0:1789518215.067796:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501658752:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518215.067832:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501658752:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 39us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518215.067839:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 385 00010000:00010000:2.0:1789518215.221676:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518215.702412:0:14456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:23:34 (1789518214) 00000100:00100000:2.0:1789518216.181911:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522702592:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.181984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182044:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522703104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182094:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522703616:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182137:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182170:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789518216.182178:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522702720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182220:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182239:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522703232:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182262:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182279:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522703744:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182341:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702592 00000100:00100000:2.0:1789518216.182350:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702592 00000100:00100000:2.0:1789518216.182388:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522703616 00000100:00100000:2.0:1789518216.182392:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522703616 00000100:00100000:2.0:1789518216.182414:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522703232 00000100:00100000:2.0:1789518216.182417:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522703232 00000100:00100000:2.0:1789518216.182429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522703744 00000100:00100000:2.0:1789518216.182432:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522703744 00000100:00100000:2.0:1789518216.182450:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789518216.182459:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522702592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182538:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522702592:12345-0@lo:400:kworker.0 Request processed in 79us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.182546:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789518216.182565:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789518216.182571:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522703616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182601:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522703616:12345-0@lo:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.182606:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789518216.182618:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789518216.182623:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522703232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182690:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522703232:12345-0@lo:400:kworker.0 Request processed in 66us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.182702:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789518216.182716:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789518216.182723:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522703744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.182739:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522702464:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182753:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522703744:12345-0@lo:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.182770:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789518216.182781:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182796:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702720 00000100:00100000:2.0:1789518216.182801:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702720 00000100:00100000:1.0:1789518216.182814:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522702976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182834:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789518216.182843:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522702720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.182851:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518216.182869:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522703488:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182894:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522702720:12345-0@lo:400:kworker.0 Request processed in 51us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518216.182902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789518216.182923:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702976 00000100:00100000:1.0:1789518216.182924:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522704000:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.182929:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702976 00000100:00100000:1.0:1789518216.182950:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.182952:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789518216.182962:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522702976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.182972:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789518216.182980:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522702848:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183000:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522702976:12345-0@lo:400:kworker.0 Request processed in 39us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.183010:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789518216.183013:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518216.183032:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522703360:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702848 00000100:00100000:2.0:1789518216.183039:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702848 00000100:00100000:1.0:1789518216.183054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.183061:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522703360 00000100:00100000:2.0:1789518216.183065:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522703360 00000100:00100000:1.0:1789518216.183067:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522703872:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789518216.183095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518216.183101:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522702848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.183134:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522702976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183140:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522702848:12345-0@lo:400:kworker.0 Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.183148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789518216.183164:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522702848:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183167:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789518216.183179:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522703360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.183194:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522702464 00000100:00100000:1.0:1789518216.183201:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522702464 00000100:00100000:2.0:1789518216.183228:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522703360:12345-0@lo:400:kworker.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.183237:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789518216.183242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789518216.183253:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522702464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183271:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522702720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183283:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522703232:0@lo:400:kworker.0 00010000:00080000:2.0:1789518216.183300:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73035bc380 x1876445522703744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518216.183302:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522702464:12345-0@lo:400:kworker.0 Request processed in 50us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518216.183320:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522703744:0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.183323:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789518216.183335:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522702592:0@lo:400:kworker.0 00000100:00100000:2.0:1789518216.183347:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522703616:0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.183366:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522703104 00000100:00100000:1.0:1789518216.183372:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522703104 00000100:00100000:1.0:1789518216.183404:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522703488 00000100:00100000:1.0:1789518216.183408:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522703488 00000100:00100000:1.0:1789518216.183432:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522704000 00000100:00100000:1.0:1789518216.183436:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522704000 00000100:00100000:1.0:1789518216.183448:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522703872 00000100:00100000:1.0:1789518216.183451:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522703872 00000100:00100000:1.0:1789518216.183506:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789518216.183520:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789518216.183521:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522703104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518216.183540:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522703488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.183575:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522703104:12345-0@lo:400:kworker.0 Request processed in 59us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518216.183585:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789518216.183595:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522703488:12345-0@lo:400:kworker.0 Request processed in 61us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518216.183604:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789518216.183667:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522703104:0@lo:400:kworker.0 00000100:00100000:0.0:1789518216.183735:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1789518216.183738:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518216.183745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518216.183747:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518216.183751:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518216.183756:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789518216.183765:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522703872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518216.183773:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522704128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518216.183807:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522703872:12345-0@lo:400:kworker.0 Request processed in 44us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518216.183814:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789518216.183829:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789518216.183853:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73035bce00 x1876445522703360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518216.183877:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522703360:0@lo:400:kworker.0 00000100:00100000:0.0:1789518216.183893:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522703872:0@lo:400:kworker.0 00000100:00100000:3.0:1789518216.183900:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522704128 00000100:00100000:0.0:1789518216.183904:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522702464:0@lo:400:kworker.0 00000100:00100000:3.0:1789518216.183907:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522704128 00000100:00100000:0.0:1789518216.183918:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522703488:0@lo:400:kworker.0 00000100:00100000:3.0:1789518216.183944:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789518216.183952:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522704128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518216.183977:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789518216.184017:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522704128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518216.184025:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789518216.184034:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1789518216.184042:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1789518216.184064:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522704128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518216.184828:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522704000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518216.184887:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522704000:12345-0@lo:400:kworker.0 Request processed in 1276us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518216.184893:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789518216.184946:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522704000:0@lo:400:kworker.0 00010000:00010000:2.0:1789518216.245920:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518216.695821:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522704256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518216.695898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518216.696220:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522704256 00000100:00100000:0.0:1789518216.696229:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522704256 00000100:00100000:0.0:1789518216.696290:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789518216.696300:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522704256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789518216.696324:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789518216.696390:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522704256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518216.696398:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789518216.696542:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522704256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518217.205893:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518217.205919:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522704384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518217.205994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518217.206291:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522704384 00000100:00100000:2.0:1789518217.206301:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522704384 00000100:00100000:2.0:1789518217.206362:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789518217.206372:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522704384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518217.206408:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789518217.206615:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522704384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 243us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518217.206622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789518217.206733:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518217.206745:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730373aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522704512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518217.206779:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518217.206933:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522704384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518217.207535:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522704640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518217.207588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518217.207743:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522704512 00000100:00100000:2.0:1789518217.207751:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522704512 00000100:00100000:2.0:1789518217.207802:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789518217.207812:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522704512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518217.207848:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518217.207908:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522704512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518217.207915:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789518217.208002:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730373aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522704512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518217.208708:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522704640 00000100:00100000:3.0:1789518217.208716:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522704640 00000100:00100000:3.0:1789518217.208762:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789518217.208771:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522704640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518217.208798:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518217.208857:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522704640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518217.208877:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789518217.209089:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522704640:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789518217.269710:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518217.281279:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518217.281564:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501659776 00000100:00100000:2.0:1789518217.281574:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501659776 00000100:00100000:2.0:1789518217.281670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 149 00000100:00100000:2.0:1789518217.281682:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+14:12118:x1876445501659776:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518217.281703:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518217.281724:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314bff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281798:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281812:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281824:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281838:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281845:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281876:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281981:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281991:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.281997:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518217.282009:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789518217.282095:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282113:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282120:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282127:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ade00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518217.282131:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282138:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282150:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:2.0:1789518217.282154:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518217.282166:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282172:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314c06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282188:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282196:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282201:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282206:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518217.282210:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282215:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282223:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e73010b5600) 00010000:00010000:2.0:1789518217.282226:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518217.282228:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282234:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314c0d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282925:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314bff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662a3 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282956:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662a3 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518217.282963:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:2.0:1789518217.282966:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518217.282969:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033adc00, rc 0) 00000100:00100000:2.0:1789518217.283094:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+16:12118:x1876445501659776:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1414us (1823us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789518217.283214:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 149 00000100:00080000:3.0:1789518217.283297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518217.291459:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518217.291548:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518217.291625:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501659904 00000100:00100000:0.0:1789518217.291648:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501659904 00000100:00100000:0.0:1789518217.291750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 150 00000100:00100000:0.0:1789518217.291763:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+16:12118:x1876445501659904:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789518217.291803:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501660032 00000100:00100000:3.0:1789518217.291819:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501660032 00000100:00100000:0.0:1789518217.291876:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+17:12118:x1876445501659904:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 115us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518217.291885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 150 00000100:00100000:3.0:1789518217.291916:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:3.0:1789518217.291930:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740963e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+16:2389:x1876445501660032:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518217.291947:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518217.303252:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662a3 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.303291:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:3.0:1789518217.303301:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518217.305020:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740963e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+15:2389:x1876445501660032:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 13076us (13453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518217.305042:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789518217.305714:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518217.310063:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501660160 00000100:00100000:0.0:1789518217.310095:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501660160 00000100:00100000:0.0:1789518217.310251:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 151 00000100:00100000:0.0:1789518217.310269:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:12118:x1876445501660160:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518217.310665:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:12118:x1876445501660160:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 402us (4953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518217.310676:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 151 00000100:00080000:3.0:1789518217.313920:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1789518217.526187:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789518218.175588:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518218.175597:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518218.176168:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789518218.176178:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789518218.303876:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518219.229393:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518219.229518:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501660288 00000100:00100000:1.0:1789518219.229527:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501660288 00000100:00100000:1.0:1789518219.229586:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00100000:1.0:1789518219.229597:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+15:12160:x1876445501660288:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518219.229628:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518219.229689:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662aa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229778:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229793:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229806:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229820:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229827:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229833:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229876:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229884:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229889:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229895:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518219.229899:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229917:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229929:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:1.0:1789518219.229932:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518219.229936:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229942:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229956:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229962:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229968:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229973:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0ce00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518219.229976:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229982:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.229989:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e7441628d00) 00010000:00010000:1.0:1789518219.229991:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518219.229994:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.230010:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.230049:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314c22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662aa expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.230057:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:1.0:1789518219.230059:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518219.230062:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662aa expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.230070:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d600, rc 0) 00000100:00100000:1.0:1789518219.230125:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+15:12160:x1876445501660288:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 530us (741us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518219.230131:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00080000:3.0:1789518219.230503:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518219.237866:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518219.237945:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501660544 00000100:00100000:2.0:1789518219.237956:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501660544 00000100:00100000:2.0:1789518219.238021:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 153 00000100:00100000:2.0:1789518219.238032:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+15:12160:x1876445501660544:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:2.0:1789518219.238087:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518219.238114:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd67942314584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660d5 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238132:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:2.0:1789518219.238149:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518219.238210:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238223:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238233:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238245:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238251:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238257:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238862:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238872:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238879:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518219.238894:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acaf6535 reply state 0000000090ef4259 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238904:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238919:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e73010b5100) 00010000:00010000:2.0:1789518219.238922:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518219.238924:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789518219.238929:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789518219.238935:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238941:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238946:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238951:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033adc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518219.238956:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238963:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238970:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e73010b5800) 00010000:00010000:2.0:1789518219.238973:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518219.238976:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.238982:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942314c37 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518219.238993:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acaf6535 reply state 0000000090ef4259 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.239009:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.239014:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e73010b5a00) 00010000:00010000:2.0:1789518219.239016:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518219.239018:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789518219.239091:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+16:12160:x1876445501660544:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 1061us (1233us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789518219.239098:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 153 00000001:00080000:1.0:1789518219.244334:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000020:00080000:1.0:1789518219.244358:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789518219.244375:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789518219.244385:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789518219.244444:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244486:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244494:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244514:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033aca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518219.244519:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244527:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244542:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e73010b5a00) 00010000:00010000:3.0:1789518219.244545:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518219.244549:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244556:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314c3e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244576:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244582:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244588:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244592:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518219.244595:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244600:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244627:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e73010b5100) 00010000:00010000:3.0:1789518219.244629:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518219.244632:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.244638:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314c45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.320636:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518219.347037:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518219.347128:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501660672 00000100:00100000:3.0:1789518219.347140:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501660672 00000100:00100000:3.0:1789518219.347201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 154 00000100:00100000:3.0:1789518219.347212:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+12:12168:x1876445501660672:12345-192.168.202.43@tcp:101:lctl.0 00010000:00010000:3.0:1789518219.347237:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518219.347260:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.347342:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314c53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.347355:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.347367:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518219.347413:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789518219.347416:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518219.347439:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.347507:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662b1 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.347539:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662b1 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.347548:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:3.0:1789518219.347551:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518219.347555:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c600, rc 0) 00000100:00100000:3.0:1789518219.347627:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+13:12168:x1876445501660672:12345-192.168.202.43@tcp:101:lctl.0 Request processed in 404us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518219.347634:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 154 00000100:00100000:2.0:1789518219.530960:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518219.535073:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501660800 00000100:00100000:0.0:1789518219.535087:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501660800 00000100:00100000:0.0:1789518219.535159:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 155 00000100:00100000:0.0:1789518219.535170:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+13:12174:x1876445501660800:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518219.535190:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518219.535219:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942314c5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662b8 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535280:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535303:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535332:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535346:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535352:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535358:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535439:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd67942314c6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535446:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd67942314c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535480:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd67942314c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518219.535512:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789518219.535515:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518219.535531:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd67942314c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535541:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535547:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535562:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535568:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518219.535572:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535580:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535591:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:0.0:1789518219.535594:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518219.535599:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535605:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942314c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535634:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535641:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535646:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535651:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518219.535654:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535670:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535678:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e7303359600) 00010000:00010000:0.0:1789518219.535681:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518219.535684:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535690:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314c68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535721:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942314c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662b8 expref: 15 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535734:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd67942314c6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662b8 expref: 14 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.535741:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518219.535743:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518219.535745:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6400, rc 0) 00000100:00100000:0.0:1789518219.535805:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+14:12174:x1876445501660800:12345-192.168.202.43@tcp:101:bash.0 Request processed in 637us (4855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518219.535812:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 155 00000100:00100000:3.0:1789518219.542882:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518219.542991:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501661056 00000100:00100000:1.0:1789518219.543002:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501661056 00000100:00100000:1.0:1789518219.543065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 156 00000100:00100000:1.0:1789518219.543075:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+14:12174:x1876445501661056:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789518219.543097:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518219.543129:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c76 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.543242:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.543257:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.543269:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.543330:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.543338:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.543345:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518219.543991:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789518219.544133:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544144:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544153:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544185:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544191:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544274:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544281:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518219.544285:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544354:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544367:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518219.544370:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518219.544375:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544381:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314c7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518219.544396:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021fa66cf reply state 0000000053589fc8 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544408:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544414:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:3.0:1789518219.544417:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518219.544419:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518219.544804:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314c76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544825:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.544855:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:3.0:1789518219.544857:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518219.544860:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9da00, rc 0) 00000100:00100000:3.0:1789518219.544930:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+17:12174:x1876445501661056:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1856us (2059us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789518219.544938:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 156 00000100:00100000:1.0:1789518219.558905:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518219.559042:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501661184 00000100:00100000:3.0:1789518219.559054:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501661184 00000100:00100000:3.0:1789518219.559127:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:3.0:1789518219.559138:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2390:x1876445501661184:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518219.559155:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518219.559178:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662c6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518219.559206:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789518219.559236:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1789518219.559241:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518219.559251:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.559269:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.559298:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c200, rc 0) 00000100:00100000:3.0:1789518219.559356:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2390:x1876445501661184:12345-192.168.202.43@tcp:101:bash.0 Request processed in 220us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518219.559376:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00080000:1.0:1789518219.560265:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518219.567563:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518219.567707:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501661312 00000100:00100000:0.0:1789518219.567717:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501661312 00000100:00100000:0.0:1789518219.567777:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:0.0:1789518219.567787:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+6:12174:x1876445501661312:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518219.567821:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518219.567838:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662cd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.567869:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.567878:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518219.567882:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518219.567887:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.567918:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.567931:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 7 pid: 8429 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518219.567945:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1876445522704768:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518219.568039:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406dadcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518219.582376:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1876445522704768:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518219.582416:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.582436:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6a00, rc 0) 00000100:00100000:0.0:1789518219.582561:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:12174:x1876445501661312:12345-192.168.202.43@tcp:101:bash.0 Request processed in 14774us (15007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518219.582570:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:1.0:1789518219.585553:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518219.585645:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501661440 00000100:00100000:0.0:1789518219.585655:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501661440 00010000:00010000:0.0:1789518219.585698:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 7 pid: 8429 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518219.585796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:0.0:1789518219.585807:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501661440:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518219.585823:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518219.585846:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 7 pid: 8429 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.585861:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 7 pid: 8429 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.585885:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccc79d2c/0x8d0fd67942314c99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662c6 expref: 7 pid: 8429 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.585907:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518219.585911:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518219.585919:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.585929:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.585990:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518219.586005:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876445522704896:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789518219.586094:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406dadcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518219.603139:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518219.603861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501661696 00000100:00100000:1.0:1789518219.603874:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501661696 00000100:00100000:1.0:1789518219.603938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:1.0:1789518219.603960:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+17:12174:x1876445501661696:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:0.0:1789518219.604249:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6499:1876445522704896:192.168.202.43@tcp:105: 00010000:00010000:0.0:1789518219.604273:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518219.604345:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501661440:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 18540us (18800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518219.604354:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:1.0:1789518219.605142:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+18:12174:x1876445501661696:12345-192.168.202.43@tcp:35:bash.0 Request processed in 1191us (2008us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789518219.605153:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:0.0:1789518219.765873:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518219.765933:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522705024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518219.766043:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518219.766342:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522705024 00000100:00100000:2.0:1789518219.766351:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522705024 00000100:00100000:2.0:1789518219.766418:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789518219.766428:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74360fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522705024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518219.766458:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518219.766540:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74360fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522705024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518219.766547:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789518219.766874:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518219.767077:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522705024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518219.789948:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518219.790123:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501661952 00000100:00100000:0.0:1789518219.790134:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501661952 00000100:00100000:0.0:1789518219.790201:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 157 00000100:00100000:0.0:1789518219.790213:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+18:12184:x1876445501661952:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518219.790254:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518219.790276:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314ca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662d4 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518219.790650:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789518219.790755:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314ca7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662d4 expref: 20 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.790784:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:0.0:1789518219.790787:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518219.790794:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942314ca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662d4 expref: 20 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.790808:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6200, rc 0) 00000100:00100000:0.0:1789518219.790888:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:12184:x1876445501661952:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 677us (949us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789518219.790895:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 157 00000100:00100000:3.0:1789518219.798774:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518219.798953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501662208 00000100:00100000:0.0:1789518219.798965:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501662208 00000100:00100000:0.0:1789518219.799027:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:0.0:1789518219.799038:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+19:12184:x1876445501662208:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518219.799323:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+20:12184:x1876445501662208:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 285us (556us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789518219.799331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:2.0:1789518219.917037:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518219.917150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501662336 00000100:00100000:1.0:1789518219.917162:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501662336 00000100:00100000:1.0:1789518219.917244:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 158 00000100:00100000:1.0:1789518219.917255:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+20:12190:x1876445501662336:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518219.917289:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518219.917313:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.917379:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314cbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.917392:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.917403:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518219.917443:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789518219.917446:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789518219.917491:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.917519:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662db expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.917537:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314cbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.917546:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:1.0:1789518219.917562:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518219.917566:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d600, rc 0) 00000100:00100000:1.0:1789518219.917643:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+21:12190:x1876445501662336:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 390us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518219.917650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 158 00000100:00100000:2.0:1789518219.922180:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518219.923514:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501662592 00000100:00100000:3.0:1789518219.923529:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501662592 00000100:00100000:3.0:1789518219.923591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 159 00000100:00100000:3.0:1789518219.923601:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+21:12190:x1876445501662592:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518219.923631:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518219.923652:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314cc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662e2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.923761:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314cca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.923776:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314cca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.923787:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314cca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518219.923798:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789518219.923905:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314cc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662e2 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.923924:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314cca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662e2 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.923932:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:3.0:1789518219.923936:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518219.923953:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031800, rc 0) 00000100:00100000:3.0:1789518219.924018:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+23:12190:x1876445501662592:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 418us (1847us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789518219.924025:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 159 00000100:00100000:0.0:1789518219.936866:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518219.936907:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518219.936984:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501662848 00000100:00100000:1.0:1789518219.936993:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501662848 00000100:00100000:1.0:1789518219.937048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 160 00000100:00100000:1.0:1789518219.937058:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+23:12190:x1876445501662848:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518219.937083:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518219.937101:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314cd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.937198:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314cdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.937223:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314cdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.937239:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314cdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518219.937252:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789518219.937347:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314cd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662e9 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.937365:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314cdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662e9 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.937390:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:1.0:1789518219.937394:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518219.937397:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d800, rc 0) 00000100:00100000:1.0:1789518219.937456:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+25:12190:x1876445501662848:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 399us (598us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1789518219.937500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 160 00000100:00100000:2.0:1789518219.938018:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501662976 00000100:00100000:2.0:1789518219.938024:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501662976 00000100:00100000:2.0:1789518219.938066:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789518219.938080:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+25:2388:x1876445501662976:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518219.938092:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518219.938105:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314cca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662e2 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.938118:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:2.0:1789518219.938121:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518219.938153:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+24:2388:x1876445501662976:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 74us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518219.938160:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:0.0:1789518219.942803:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518219.944638:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501663104 00000100:00100000:1.0:1789518219.944653:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501663104 00000100:00100000:1.0:1789518219.944726:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:1.0:1789518219.944737:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501663104:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:1.0:1789518219.944782:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.944803:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.944813:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518219.944817:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518219.944822:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.944858:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518219.944873:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 6 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518219.944903:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9982:1876445522705152:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518219.944998:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518219.947965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518219.948069:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501663232 00000100:00100000:2.0:1789518219.948080:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501663232 00002000:00100000:2.0:1789518219.948132:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e7303d60a80 x1876445501663232/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:620/0 lens 504/0 e 0 to 0 dl 1789518230 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518219.948144:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303d60a80 with x1876445501663232 ext(0->12) 00010000:00010000:2.0:1789518219.948153:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 7 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.948170:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 7 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518219.948179:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7303d60a80 00000100:00100000:2.0:1789518219.948215:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:2.0:1789518219.948226:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501663232:12345-192.168.202.43@tcp:4:lfs.0 00000100:00100000:2.0:1789518219.957006:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501663232:12345-192.168.202.43@tcp:4:lfs.0 Request processed in 8771us (9040us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789518219.957035:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00002000:00100000:2.0:1789518219.957051:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e7303d60a80 x1876445501663232/t4294967306(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:620/0 lens 504/448 e 0 to 0 dl 1789518230 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518219.957061:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303d60a80 with x1876445501663232 ext(0->12) 00010000:00010000:2.0:1789518219.957073:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 9 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.957096:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 9 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518219.957105:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7303d60a80 00000100:00100000:3.0:1789518219.963583:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9982:1876445522705152:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518219.963627:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518219.964970:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518219.965112:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501663360 00000100:00100000:2.0:1789518219.965121:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501663360 00010000:00010000:2.0:1789518219.965160:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 9 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518219.965202:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:2.0:1789518219.965213:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+9:2390:x1876445501663360:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518219.965237:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518219.965255:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789518219.965258:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789518219 00002000:00010000:2.0:1789518219.965261:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789518219 00002000:00010000:2.0:1789518219.965263:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789518219 00002000:00010000:2.0:1789518219.965265:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789518219.965272:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 9 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.965299:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 9 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.965320:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c81fe541/0x8d0fd67942314ca0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662cd expref: 9 pid: 8428 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.965336:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518219.965341:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518219.965346:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.965356:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.965388:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518219.965519:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965530:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965550:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965558:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965566:0:9982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965573:0:9982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518219.965577:0:9982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965598:0:9982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965620:0:9982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.965627:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047cf84ac/0x8d0fd67942314ced lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518219.965786:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+8:2390:x1876445501663360:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 574us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518219.965794:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:3.0:1789518219.969214:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501663104:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 24454us (26395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518219.969242:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:0.0:1789518219.972740:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518219.972829:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501663616 00000100:00100000:3.0:1789518219.972841:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501663616 00000100:00100000:3.0:1789518219.972905:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:3.0:1789518219.972917:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+24:12190:x1876445501663616:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:3.0:1789518219.972977:0:6517:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314cdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662e9 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518219.973167:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789518219.973202:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789518219.973712:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789518219.973756:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.973772:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.973795:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.973828:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.973842:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 28 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518219.973855:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1876445522705280:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518219.973942:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518219.976995:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1876445522705280:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518219.977030:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518219.977246:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518219.977499:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501663744 00000100:00100000:2.0:1789518219.977508:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501663744 00010000:00010000:2.0:1789518219.977542:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 29 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518219.977575:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:2.0:1789518219.977584:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+29:2388:x1876445501663744:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518219.977640:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518219.977647:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 29 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.977660:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 29 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.977680:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942314c8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662bf expref: 29 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.977707:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:2.0:1789518219.977712:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.977721:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.977728:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518219.977757:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518219.977818:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+28:2388:x1876445501663744:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 235us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518219.977826:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00010000:00010000:0.0:1789518219.978270:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518219.978290:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518219.978394:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1789518219.978545:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1789518219.978645:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522705408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518219.978694:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518219.978724:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518219.978899:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522705408 00000100:00100000:2.0:1789518219.978905:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522705408 00000100:00100000:2.0:1789518219.978957:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789518219.978964:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1876445522705408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518219.979043:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1876445522705408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518219.979057:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1789518219.979156:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518219.979684:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522705408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789518219.979802:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1789518219.979852:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522705536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518219.979888:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518219.979906:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518219.979961:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522705536 00000100:00100000:1.0:1789518219.979967:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522705536 00000100:00100000:1.0:1789518219.980007:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789518219.980015:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1876445522705536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518219.980124:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1876445522705536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (234us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789518219.980131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789518219.980207:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522705536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518219.980256:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789518219.980289:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.980307:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.980312:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.980315:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518219.980319:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.980325:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.980334:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:3.0:1789518219.980336:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789518219.980340:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.980343:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942314cf4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518219.980408:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789518219.980455:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789518219.980509:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387766044047ns, next at 388766041350ns, rc = 0 00000001:00080000:3.0:1789518219.980515:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789518219.980534:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04900) 00010000:00010000:3.0:1789518219.980536:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518219.980541:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314cdf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662e9 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518219.980640:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+31:12190:x1876445501663616:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 7726us (7909us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789518219.980648:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00000020:00080000:3.0:1789518219.980656:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789518219.984851:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518219.984923:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501663872 00000100:00100000:3.0:1789518219.984934:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501663872 00000100:00100000:3.0:1789518219.984989:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 161 00000100:00100000:3.0:1789518219.984998:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+31:12190:x1876445501663872:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518219.985022:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518219.985043:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314cfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662f0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.985094:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314cfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662f0 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.985108:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314cfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662f0 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518219.985126:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518219.985130:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518219.985134:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:3.0:1789518219.985196:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+32:12190:x1876445501663872:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 199us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518219.985203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 161 00000100:00100000:1.0:1789518220.001591:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518220.001947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501664128 00000100:00100000:0.0:1789518220.001957:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501664128 00000100:00100000:0.0:1789518220.002053:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:0.0:1789518220.002064:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+32:12190:x1876445501664128:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518220.002381:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+33:12190:x1876445501664128:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 318us (799us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789518220.002389:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:1.0:1789518220.132565:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518220.132686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501664384 00000100:00100000:2.0:1789518220.132697:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501664384 00000100:00100000:2.0:1789518220.132759:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00100000:2.0:1789518220.132769:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+33:12200:x1876445501664384:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518220.132792:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518220.132812:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518220.132911:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789518220.133006:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314d02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662f7 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.133020:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:2.0:1789518220.133023:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518220.133028:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd67942314d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662f7 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.133041:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad200, rc 0) 00000100:00100000:2.0:1789518220.133113:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+34:12200:x1876445501664384:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 344us (556us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789518220.133121:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00100000:1.0:1789518220.147114:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.147262:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501664512 00000100:00100000:3.0:1789518220.147283:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501664512 00000100:00100000:3.0:1789518220.147358:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:3.0:1789518220.147369:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+34:12200:x1876445501664512:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:3.0:1789518220.147446:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147495:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147509:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147521:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147528:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147535:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147621:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147630:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147637:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518220.147686:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147698:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147711:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147717:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147723:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518220.147727:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147735:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147747:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518220.147750:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518220.147756:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147761:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147776:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147781:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147786:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147791:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518220.147799:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147805:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.147813:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:3.0:1789518220.148209:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518220.148214:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148222:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148235:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148240:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148246:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148250:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518220.148253:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148259:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148266:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518220.148268:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518220.148289:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.148294:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518220.148429:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+34:12200:x1876445501664512:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 1061us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518220.148437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:1.0:1789518220.158169:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.158366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501664768 00000100:00100000:3.0:1789518220.158377:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501664768 00000100:00100000:3.0:1789518220.158434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:3.0:1789518220.158444:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+34:12200:x1876445501664768:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789518220.158708:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+35:12200:x1876445501664768:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 264us (547us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789518220.158716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:1.0:1789518220.183912:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518220.183985:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518220.184019:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518220.184052:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518220.184078:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518220.184106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501665408 00000100:00100000:1.0:1789518220.184116:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501665408 00000100:00100000:1.0:1789518220.184174:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501665024 00000100:00100000:1.0:1789518220.184177:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501665024 00000100:00100000:1.0:1789518220.184191:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501665280 00000100:00100000:1.0:1789518220.184193:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501665280 00000100:00100000:1.0:1789518220.184253:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 320 00000100:00100000:1.0:1789518220.184262:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501665408:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518220.184512:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501665152 00000100:00100000:2.0:1789518220.184518:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501665152 00000100:00100000:2.0:1789518220.184552:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00100000:2.0:1789518220.184559:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501665152:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518220.184653:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501665152:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 93us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518220.184660:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00100000:0.0:1789518220.184683:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 321 00000100:00100000:2.0:1789518220.184688:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 322 00000100:00100000:0.0:1789518220.184692:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501665024:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518220.184694:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501665280:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518220.184720:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501665280:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518220.185615:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 322 00000100:00100000:3.0:1789518220.185864:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501664896 00000100:00100000:3.0:1789518220.185872:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501664896 00000100:00100000:3.0:1789518220.185920:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 387 00000100:00100000:3.0:1789518220.185929:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501664896:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518220.188028:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501665024:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 3326us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518220.188043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 321 00000100:00080000:1.0:1789518220.188104:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518220.188111:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518220.188114:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518220.188131:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501665408:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 3868us (4108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518220.188138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 320 00000100:00100000:3.0:1789518220.198557:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501664896:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 12617us (14642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518220.198574:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 387 00000100:00100000:1.0:1789518220.198890:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.199592:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501665664 00000100:00100000:3.0:1789518220.199621:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501665664 00000100:00100000:3.0:1789518220.199681:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:3.0:1789518220.199691:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+35:12203:x1876445501665664:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518220.199732:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518220.199754:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785662fe expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200036:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200050:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200061:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200070:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200077:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200083:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200190:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200198:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200205:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518220.200214:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789518220.200670:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200679:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200686:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200691:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518220.200695:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200703:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200715:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518220.200718:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518220.200723:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200730:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314d2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200744:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200749:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200755:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200771:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518220.200773:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200781:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200790:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:3.0:1789518220.200792:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518220.200795:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200802:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314d33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200923:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314d25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 38 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200940:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 37 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.200948:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518220.200950:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518220.200953:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf400, rc 0) 00000100:00100000:3.0:1789518220.201022:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+37:12203:x1876445501665664:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1332us (2133us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789518220.201031:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:1.0:1789518220.205789:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.205944:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501665792 00000100:00100000:3.0:1789518220.205968:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501665792 00000100:00100000:3.0:1789518220.206032:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:3.0:1789518220.206042:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+37:12203:x1876445501665792:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:3.0:1789518220.206111:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206129:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206143:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206179:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206186:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206192:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206198:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcfa00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518220.206202:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206211:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206222:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518220.206225:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518220.206230:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.206258:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518220.206541:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+37:12203:x1876445501665792:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 421us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518220.206551:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:2.0:1789518220.211692:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.211771:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501666048 00000100:00100000:3.0:1789518220.211780:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501666048 00000100:00100000:3.0:1789518220.211841:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789518220.211852:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+37:12203:x1876445501666048:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789518220.212088:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+38:12203:x1876445501666048:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 238us (404us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789518220.212096:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00010000:00010000:3.0:1789518220.341662:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518220.695059:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.695268:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501666304 00000100:00100000:3.0:1789518220.695279:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501666304 00000100:00100000:3.0:1789518220.695340:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 166 00000100:00100000:3.0:1789518220.695351:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+38:12234:x1876445501666304:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:3.0:1789518220.695376:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518220.695397:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566305 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.695543:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.695558:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.695587:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518220.695611:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789518220.695713:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566305 expref: 41 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.695742:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566305 expref: 40 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.695751:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518220.695754:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518220.695758:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf600, rc 0) 00000100:00100000:3.0:1789518220.695816:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+40:12234:x1876445501666304:12345-192.168.202.43@tcp:101:cat.0 Request processed in 467us (766us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789518220.695823:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 166 00000100:00100000:1.0:1789518220.701768:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.702563:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501666560 00000100:00100000:3.0:1789518220.702575:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501666560 00000100:00100000:3.0:1789518220.702649:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:3.0:1789518220.702659:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+40:12234:x1876445501666560:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:3.0:1789518220.702908:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+41:12234:x1876445501666560:12345-192.168.202.43@tcp:35:cat.0 Request processed in 250us (1150us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789518220.702916:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:2.0:1789518220.703765:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518220.703840:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501666688 00000100:00100000:0.0:1789518220.703845:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501666688 00000100:00100000:0.0:1789518220.703897:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:0.0:1789518220.703906:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+41:2389:x1876445501666688:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518220.703918:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518220.703940:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566305 expref: 41 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.703976:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518220.703982:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518220.704028:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+40:2389:x1876445501666688:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 124us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518220.704036:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:2.0:1789518220.813017:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518220.813153:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501666944 00000100:00100000:0.0:1789518220.813165:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501666944 00000100:00100000:0.0:1789518220.813231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 167 00000100:00100000:0.0:1789518220.813241:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+40:12241:x1876445501666944:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:0.0:1789518220.813267:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518220.813271:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518220.813298:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314cbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662db expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.813318:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518220.813323:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518220.813336:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314d64 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856630c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.813441:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.813534:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 40 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.813554:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.813610:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 40 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.813625:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 40 pid: 8781 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518220.813639:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522705664:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518220.813739:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518220.828299:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518220.828413:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501667072 00000100:00100000:2.0:1789518220.828429:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501667072 00010000:00010000:2.0:1789518220.828502:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 41 pid: 8781 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518220.828526:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c63800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522705664:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518220.828553:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518220.828561:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:2.0:1789518220.828574:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+41:2388:x1876445501667072:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518220.828588:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518220.828595:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 41 pid: 8781 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.828619:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 41 pid: 8781 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.828659:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314d3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662fe expref: 41 pid: 8781 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.828675:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518220.828680:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.828691:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.828699:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518220.828738:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518220.828796:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+40:2388:x1876445501667072:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 223us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518220.828804:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 81 00010000:00010000:0.0:1789518220.828992:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.829000:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518220.829024:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789518220.829169:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314d64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.829184:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518220.829192:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518220.829194:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518220.829203:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6000, rc 0) 00000100:00100000:0.0:1789518220.829243:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+40:12241:x1876445501666944:12345-192.168.202.43@tcp:101:dd.0 Request processed in 16004us (16238us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789518220.829251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 167 00000100:00100000:1.0:1789518220.833861:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518220.833956:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501667200 00000100:00100000:3.0:1789518220.833966:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501667200 00000100:00100000:3.0:1789518220.834056:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 168 00000100:00100000:3.0:1789518220.834067:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+40:12241:x1876445501667200:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:3.0:1789518220.834098:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518220.834119:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566313 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.834153:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.834168:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.834181:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.834329:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314d79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 42 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.834349:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 41 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518220.834358:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518220.834361:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518220.834365:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf600, rc 0) 00000100:00100000:3.0:1789518220.834427:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+41:12241:x1876445501667200:12345-192.168.202.43@tcp:101:dd.0 Request processed in 362us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518220.834433:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 168 00000100:00100000:2.0:1789518220.841436:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518220.844808:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501667456 00000100:00100000:1.0:1789518220.844826:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501667456 00000100:00100000:1.0:1789518220.844945:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 169 00000100:00100000:1.0:1789518220.844958:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+41:12241:x1876445501667456:12345-192.168.202.43@tcp:36:dd.0 00010000:00010000:1.0:1789518220.845177:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518220.845208:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518220.845220:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518220.845263:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789518220.845301:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008742710c reply state 0000000026fb86c7 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518220.845330:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518220.845338:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:1.0:1789518220.845341:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789518220.845345:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518220.845458:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+44:12241:x1876445501667456:12345-192.168.202.43@tcp:36:dd.0 Request processed in 502us (4031us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789518220.845493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 169 00000020:00080000:1.0:1789518220.845498:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789518221.301882:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522705920:0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.301957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518221.302028:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522706432:0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.302054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518221.302079:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522706944:0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.302099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518221.302125:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789518221.302131:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730373a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522705792:0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.302161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518221.302187:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522705920 00000100:00100000:0.0:1789518221.302190:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522706304:0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.302197:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522705920 00000100:00100000:0.0:1789518221.302222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518221.302249:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522706816:0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.302255:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706304 00000100:00100000:3.0:1789518221.302272:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706304 00000100:00100000:0.0:1789518221.302273:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518221.302294:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e744160c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522707328:0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.302319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518221.302324:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789518221.302337:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522706304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.302346:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522707456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518221.302374:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518221.302446:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706944 00000100:00100000:2.0:1789518221.302452:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706944 00000100:00100000:2.0:1789518221.302505:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789518221.302513:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522705920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.302587:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522706304:0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.302644:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522705792 00000100:00100000:0.0:1789518221.302648:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522705792 00000100:00100000:0.0:1789518221.302673:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789518221.302686:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522705792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518221.302765:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522706176:0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.309542:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522706304:12345-0@lo:400:kworker.0 Request processed in 7198us (7310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518221.309558:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789518221.309636:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706432 00000100:00100000:3.0:1789518221.309647:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706432 00000100:00100000:3.0:1789518221.309703:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706816 00000100:00100000:3.0:1789518221.309707:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706816 00000100:00100000:3.0:1789518221.309724:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522707328 00000100:00100000:3.0:1789518221.309727:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522707328 00000100:00100000:3.0:1789518221.309746:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789518221.309753:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522706432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.311456:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522706432:12345-0@lo:400:kworker.0 Request processed in 1692us (9390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518221.311486:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789518221.311520:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789518221.311533:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522706816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.311605:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522706816:12345-0@lo:400:kworker.0 Request processed in 68us (9321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518221.311613:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789518221.311626:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789518221.311633:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522707328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.311665:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522707328:12345-0@lo:400:kworker.0 Request processed in 33us (9346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518221.311671:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789518221.311732:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522706816:0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.311762:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e744160c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522707328:0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.311774:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522706432:0@lo:400:kworker.0 00000100:00100000:3.0:1789518221.313697:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789518221.313717:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522706944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.313762:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522705920:12345-0@lo:400:kworker.0 Request processed in 11246us (11801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518221.313772:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789518221.313781:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522706944:12345-0@lo:400:kworker.0 Request processed in 72us (11680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518221.313789:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789518221.313833:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522705920:0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.313844:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522706944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.313907:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522707456 00000100:00100000:2.0:1789518221.313914:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522707456 00000100:00100000:2.0:1789518221.313946:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789518221.313952:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522707456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518221.313975:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789518221.314009:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522707456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (11636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518221.314015:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789518221.314035:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730373aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522706048:0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.314101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518221.314123:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522706560:0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.314142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518221.314154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522707072:0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.314170:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518221.314205:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522707456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518221.314220:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706560 00000100:00100000:2.0:1789518221.314223:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706560 00000100:00100000:2.0:1789518221.314241:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522707072 00000100:00100000:2.0:1789518221.314243:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522707072 00000100:00100000:2.0:1789518221.314255:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789518221.314260:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522706560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.314288:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522706560:12345-0@lo:400:kworker.0 Request processed in 29us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518221.314294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789518221.314304:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789518221.314309:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522707072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.314337:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522707072:12345-0@lo:400:kworker.0 Request processed in 28us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518221.314342:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789518221.314361:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522706560:0@lo:400:kworker.0 00010000:00080000:2.0:1789518221.314371:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435f22d80 x1876445522707072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518221.314381:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522707072:0@lo:400:kworker.0 00000100:00080000:2.0:1789518221.314513:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518221.314517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518221.314520:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518221.314522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518221.314532:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706048 00000100:00100000:2.0:1789518221.314535:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706048 00000100:00100000:2.0:1789518221.314564:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789518221.314569:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522706048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.314650:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522706048:12345-0@lo:400:kworker.0 Request processed in 80us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518221.314656:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789518221.314677:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730373aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522706048:0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.315715:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522705792:12345-0@lo:400:kworker.0 Request processed in 13026us (13550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518221.315725:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789518221.315868:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730373a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522705792:0@lo:400:kworker.0 00000100:00100000:1.0:1789518221.315955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518221.316019:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522706688:0@lo:400:kworker.0 00000100:00100000:1.0:1789518221.316040:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518221.316110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522707200:0@lo:400:kworker.0 00000100:00100000:1.0:1789518221.316132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518221.316200:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522707200 00000100:00100000:0.0:1789518221.316205:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522707200 00000100:00100000:0.0:1789518221.316266:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1789518221.316355:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518221.317874:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522707200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518221.317980:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522707200:12345-0@lo:400:kworker.0 Request processed in 1704us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518221.317989:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789518221.318123:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522707200:0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.318564:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706176 00000100:00100000:2.0:1789518221.318573:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706176 00000100:00100000:2.0:1789518221.318742:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522706688 00000100:00100000:2.0:1789518221.318747:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522706688 00000100:00080000:0.0:1789518221.318809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518221.318849:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789518221.318859:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522706176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518221.318922:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522706176:12345-0@lo:400:kworker.0 Request processed in 64us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518221.318928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789518221.318943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789518221.318950:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522706688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518221.318997:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522706688:12345-0@lo:400:kworker.0 Request processed in 47us (2955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518221.319003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789518221.319080:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522706176:0@lo:400:kworker.0 00010000:00080000:0.0:1789518221.319094:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302ab9f80 x1876445522706688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518221.319104:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522706688:0@lo:400:kworker.0 00000100:00100000:2.0:1789518221.323835:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518221.323900:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501667584 00000100:00100000:1.0:1789518221.323909:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501667584 00000100:00100000:1.0:1789518221.324032:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 170 00000100:00100000:1.0:1789518221.324043:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+44:12255:x1876445501667584:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:1.0:1789518221.324068:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518221.324090:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314d8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856631a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324160:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324176:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324190:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324202:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324209:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324215:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324710:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324738:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324746:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324783:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.324797:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 45 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518221.324811:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522707584:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518221.324892:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25780 going to sleep for 11 seconds 00000100:00080000:0.0:1789518221.325427:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518221.327957:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522707584:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789518221.327990:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518221.329152:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518221.329328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501667840 00000100:00100000:3.0:1789518221.329338:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501667840 00000100:00100000:3.0:1789518221.329397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:3.0:1789518221.329407:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+46:6160:x1876445501667840:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789518221.329771:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+47:6160:x1876445501667840:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 364us (624us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789518221.329780:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:2.0:1789518221.335432:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518221.335812:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501667968 00000100:00100000:0.0:1789518221.335822:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501667968 00010000:00010000:0.0:1789518221.335862:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 47 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518221.335927:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:0.0:1789518221.335937:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740973c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+47:2388:x1876445501667968:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518221.335950:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518221.335969:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 47 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.335982:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 47 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.336003:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314d6b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856630c expref: 47 pid: 6514 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.336018:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518221.336024:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.336034:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.336042:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.336072:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518221.336126:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740973c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+46:2388:x1876445501667968:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 190us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518221.336133:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 82 00010000:00010000:1.0:1789518221.336236:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336245:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518221.336295:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789518221.336299:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789518221.336320:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336341:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336352:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336368:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336375:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336381:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518221.336386:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336393:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336401:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:1.0:1789518221.336404:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518221.336407:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336413:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314d95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336423:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336429:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336448:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336453:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518221.336456:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336494:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336502:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:1.0:1789518221.336504:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518221.336508:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336514:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314d9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336546:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314d8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856631a expref: 46 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336561:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856631a expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518221.336569:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:1.0:1789518221.336572:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518221.336575:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d400, rc 0) 00000100:00100000:1.0:1789518221.336629:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+45:12255:x1876445501667584:12345-192.168.202.43@tcp:101:stat.0 Request processed in 12588us (12803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518221.336654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 170 00010000:00010000:2.0:1789518221.366215:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518221.457715:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518221.457802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501668224 00000100:00100000:0.0:1789518221.457812:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501668224 00000100:00100000:0.0:1789518221.457876:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 171 00000100:00100000:0.0:1789518221.457888:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+45:12261:x1876445501668224:12345-192.168.202.43@tcp:36:truncate.0 00010000:00010000:0.0:1789518221.457941:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518221.457966:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd67942314da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856631a expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.457999:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518221.458004:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518221.458171:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.458187:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.458210:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518221.458266:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1789518221.458288:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068081504 reply state 00000000e3357699 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.458301:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.458308:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518221.458311:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518221.458314:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518221.458407:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+47:12261:x1876445501668224:12345-192.168.202.43@tcp:36:truncate.0 Request processed in 521us (702us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789518221.458415:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 171 00000020:00080000:0.0:1789518221.458420:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789518221.740051:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518221.740267:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501668352 00000100:00100000:0.0:1789518221.740278:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501668352 00000100:00100000:0.0:1789518221.740342:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 172 00000100:00100000:0.0:1789518221.740353:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+47:12275:x1876445501668352:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:0.0:1789518221.740393:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518221.740412:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314db1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566321 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740524:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740539:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740552:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740563:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740571:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740578:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740945:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740957:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.740964:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518221.741007:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789518221.741019:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518221.741044:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741058:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741066:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741073:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741080:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741086:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518221.741090:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741098:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741110:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518221.741114:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518221.741118:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741125:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314db8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741139:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741157:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741163:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741167:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518221.741170:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741177:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741184:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:0.0:1789518221.741187:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518221.741190:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741196:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.741225:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314db1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 49 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.742430:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 48 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518221.742440:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518221.742442:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518221.742457:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7200, rc 0) 00000100:00100000:0.0:1789518221.742635:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+48:12275:x1876445501668352:12345-192.168.202.43@tcp:101:stat.0 Request processed in 2281us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518221.742724:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 172 00000100:00100000:2.0:1789518221.813885:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522707712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518221.813960:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518221.814097:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522707712 00000100:00100000:3.0:1789518221.814106:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522707712 00000100:00100000:3.0:1789518221.814169:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789518221.814179:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522707712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789518221.814202:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789518221.814260:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522707712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518221.814266:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789518221.814426:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522707712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518221.944623:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518221.944740:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501668608 00000100:00100000:2.0:1789518221.944752:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501668608 00000100:00100000:2.0:1789518221.944935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 173 00000100:00100000:2.0:1789518221.944946:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+48:12285:x1876445501668608:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518221.944967:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518221.944987:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566328 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518221.945090:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789518221.945195:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314dcd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566328 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518221.945211:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:2.0:1789518221.945214:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518221.945220:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566328 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518221.945235:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad600, rc 0) 00000100:00100000:2.0:1789518221.945304:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+49:12285:x1876445501668608:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 360us (692us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1789518221.945311:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 173 00000100:00100000:2.0:1789518221.953343:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518221.953499:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501668864 00000100:00100000:3.0:1789518221.953516:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501668864 00000100:00100000:3.0:1789518221.953568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:3.0:1789518221.953577:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+49:12285:x1876445501668864:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789518221.953816:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+50:12285:x1876445501668864:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 238us (481us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789518221.953825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:3.0:1789518222.063722:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518222.063902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501669120 00000100:00100000:1.0:1789518222.063913:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501669120 00000100:00100000:1.0:1789518222.064017:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 174 00000100:00100000:1.0:1789518222.064027:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+50:12291:x1876445501669120:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789518222.064050:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518222.064069:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314ddb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856632f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.064173:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.064187:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 51 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.064196:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.064224:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 51 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.064236:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 51 pid: 8781 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518222.064248:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73035bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522707840:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518222.064347:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518222.069675:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518222.069980:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73035bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522707840:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789518222.070030:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518222.070111:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501669248 00000100:00100000:0.0:1789518222.070120:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501669248 00010000:00010000:0.0:1789518222.070158:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 52 pid: 8781 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518222.070202:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:0.0:1789518222.070212:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+52:2387:x1876445501669248:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518222.070227:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518222.070235:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 52 pid: 8781 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.070247:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 52 pid: 8781 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.070269:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314dc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566321 expref: 52 pid: 8781 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.070504:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518222.070510:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.070520:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.070536:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.070650:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518222.070710:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+51:2387:x1876445501669248:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 498us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518222.070717:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 83 00010000:00010000:1.0:1789518222.071875:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.071887:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518222.071907:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789518222.072046:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd67942314ddb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.072066:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518222.072074:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:1.0:1789518222.072077:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518222.072081:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d600, rc 0) 00000100:00100000:1.0:1789518222.073498:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+51:12291:x1876445501669120:12345-192.168.202.43@tcp:101:bash.0 Request processed in 9465us (9778us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789518222.073510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 174 00000100:00100000:2.0:1789518222.080991:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.081071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501669504 00000100:00100000:0.0:1789518222.081083:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501669504 00000100:00100000:0.0:1789518222.081156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 175 00000100:00100000:0.0:1789518222.081167:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+51:12291:x1876445501669504:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:0.0:1789518222.081435:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.081452:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.081460:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518222.081530:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1789518222.081546:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0ae3125 reply state 00000000dabc8cff transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.081555:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.081560:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518222.081563:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518222.081577:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518222.081680:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+54:12291:x1876445501669504:12345-192.168.202.43@tcp:36:bash.0 Request processed in 510us (695us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789518222.081688:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 175 00000020:00080000:0.0:1789518222.081694:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789518222.090151:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.090498:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501669632 00000100:00100000:0.0:1789518222.090509:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501669632 00000100:00100000:0.0:1789518222.090634:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 176 00000100:00100000:0.0:1789518222.090645:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+54:12291:x1876445501669632:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518222.090671:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518222.090693:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314df7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566336 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.090784:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.090809:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.090818:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.090850:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.090865:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 55 pid: 6515 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518222.090877:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d62680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522707968:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518222.090975:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518222.095694:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d62680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522707968:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518222.095727:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518222.097687:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.098766:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501669760 00000100:00100000:0.0:1789518222.098782:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501669760 00010000:00010000:0.0:1789518222.099726:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 56 pid: 6515 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518222.099911:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:0.0:1789518222.099923:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+56:2388:x1876445501669760:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518222.099940:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518222.099947:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 56 pid: 6515 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.099961:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 56 pid: 6515 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.099984:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314de2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856632f expref: 56 pid: 6515 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.100002:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518222.100007:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.100017:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.100040:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.100085:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518222.100156:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+55:2388:x1876445501669760:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 235us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518222.100163:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00010000:00010000:3.0:1789518222.100644:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518222.100654:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518222.100709:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789518222.100713:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518222.100735:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518222.100768:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314df7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566336 expref: 55 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518222.100783:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566336 expref: 54 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518222.100790:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518222.100793:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518222.100795:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6c00, rc 0) 00000100:00100000:3.0:1789518222.100853:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+54:12291:x1876445501669632:12345-192.168.202.43@tcp:101:bash.0 Request processed in 10210us (10712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518222.100871:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 176 00000100:00100000:2.0:1789518222.109356:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518222.109672:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501670016 00000100:00100000:3.0:1789518222.109684:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501670016 00000100:00100000:3.0:1789518222.109736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:3.0:1789518222.109745:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+54:12291:x1876445501670016:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:3.0:1789518222.109996:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+55:12291:x1876445501670016:12345-192.168.202.43@tcp:35:bash.0 Request processed in 251us (650us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789518222.110004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:1.0:1789518222.214628:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518222.214727:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501670272 00000100:00100000:2.0:1789518222.214738:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501670272 00000100:00100000:2.0:1789518222.214805:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 177 00000100:00100000:2.0:1789518222.214814:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+55:12301:x1876445501670272:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518222.214838:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518222.214857:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856633d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518222.215060:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789518222.215150:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856633d expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.215163:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:2.0:1789518222.215166:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518222.215171:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856633d expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.215183:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ade00, rc 0) 00000100:00100000:2.0:1789518222.215239:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+56:12301:x1876445501670272:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 426us (650us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789518222.215246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 177 00000100:00100000:1.0:1789518222.221276:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518222.221342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501670400 00000100:00100000:2.0:1789518222.221354:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501670400 00000100:00100000:2.0:1789518222.221440:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 178 00000100:00100000:2.0:1789518222.221450:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+56:12301:x1876445501670400:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789518222.221565:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221581:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221605:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221617:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221626:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221632:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221707:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221716:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221723:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518222.221770:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221783:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221808:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221815:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221821:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ade00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518222.221826:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221833:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221844:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:2.0:1789518222.221847:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518222.221851:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221857:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221868:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221874:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221880:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221885:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518222.221894:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221899:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221905:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:2.0:1789518222.221906:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518222.221908:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221912:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221919:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221922:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.221926:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.222102:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518222.222104:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.222109:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.222115:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518222.222116:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518222.222123:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.222126:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518222.222194:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+56:12301:x1876445501670400:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 736us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518222.222202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 178 00000100:00100000:1.0:1789518222.224891:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518222.224973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501670656 00000100:00100000:3.0:1789518222.224982:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501670656 00000100:00100000:3.0:1789518222.225038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789518222.225049:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+56:12301:x1876445501670656:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789518222.230737:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+57:12301:x1876445501670656:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 5680us (5844us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789518222.230749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000040:00080000:2.0:1789518222.261690:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518222.261700:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518222.261800:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789518222.261807:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789518222.277752:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518222.277904:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501670912 00000100:00100000:2.0:1789518222.277916:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501670912 00000100:00100000:2.0:1789518222.277990:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 179 00000100:00100000:2.0:1789518222.278000:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+57:12304:x1876445501670912:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518222.278024:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518222.278045:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566344 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278114:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278128:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278138:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278147:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278167:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278173:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278498:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314e3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278509:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278517:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518222.278527:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789518222.278622:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278629:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278636:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278641:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ace00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518222.278644:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278651:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278671:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:2.0:1789518222.278674:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518222.278680:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278685:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942314e2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278698:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278704:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278710:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278715:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ade00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518222.278718:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278725:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278732:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:2.0:1789518222.278735:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518222.278738:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278744:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278876:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566344 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278894:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314e3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566344 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.278901:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518222.278903:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518222.278905:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033aca00, rc 0) 00000100:00100000:2.0:1789518222.278985:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+59:12304:x1876445501670912:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 986us (1243us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789518222.278993:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 179 00000100:00100000:1.0:1789518222.282940:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518222.282987:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518222.283066:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501671040 00000100:00100000:3.0:1789518222.283076:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501671040 00000100:00100000:3.0:1789518222.283147:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789518222.283159:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+59:2387:x1876445501671040:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518222.283176:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518222.283201:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942314e3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566344 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518222.283219:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518222.283223:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518222.283312:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+58:2387:x1876445501671040:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 155us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518222.283319:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:0.0:1789518222.283390:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501671168 00000100:00100000:0.0:1789518222.283395:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501671168 00000100:00100000:0.0:1789518222.283432:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 180 00000100:00100000:0.0:1789518222.283440:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+58:12304:x1876445501671168:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:0.0:1789518222.283530:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283544:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283554:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283600:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283607:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283614:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283620:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518222.283631:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283640:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283648:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518222.283651:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518222.283655:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.283661:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518222.283694:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+58:12304:x1876445501671168:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 255us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518222.283700:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 180 00000100:00100000:1.0:1789518222.289728:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.289819:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501671424 00000100:00100000:0.0:1789518222.289830:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501671424 00000100:00100000:0.0:1789518222.289883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:0.0:1789518222.289893:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+58:12304:x1876445501671424:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518222.290109:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+59:12304:x1876445501671424:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 216us (389us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789518222.290117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:2.0:1789518222.325695:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518222.325723:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522708096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518222.325775:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518222.325786:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522708224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518222.325794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518222.325839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522708096 00000100:00100000:3.0:1789518222.325847:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522708096 00000100:00100000:2.0:1789518222.325885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518222.325891:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522708224 00000100:00100000:3.0:1789518222.325893:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522708224 00000100:00100000:3.0:1789518222.325909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789518222.325917:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522708096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518222.325957:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789518222.326005:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522708096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518222.326047:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789518222.326056:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522708224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518222.326074:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00080000:1.0:1789518222.326119:0:8445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390111653836ns, next at 391111651109ns, rc = 0 00000100:00100000:2.0:1789518222.326125:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522708224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518222.326132:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789518222.326191:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522708096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518222.326227:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522708352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518222.326254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518222.326524:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522708352 00000100:00100000:1.0:1789518222.326529:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522708352 00000100:00100000:1.0:1789518222.326561:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789518222.326568:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522708352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518222.326597:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789518222.329165:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522708352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2586us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518222.329181:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789518222.332582:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522708352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518222.332619:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522708224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518222.335395:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00010000:2.0:1789518222.390010:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518222.487787:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.487909:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501671680 00000100:00100000:0.0:1789518222.487919:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501671680 00000100:00100000:0.0:1789518222.487990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:0.0:1789518222.487999:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+59:12322:x1876445501671680:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:0.0:1789518222.488024:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518222.488056:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856634b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.488164:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.488178:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.488190:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518222.488203:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789518222.488330:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856634b expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.488351:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856634b expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.488359:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518222.488362:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789518222.488365:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7000, rc 0) 00000100:00100000:0.0:1789518222.488436:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+61:12322:x1876445501671680:12345-192.168.202.43@tcp:101:cat.0 Request processed in 437us (660us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789518222.488444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:1.0:1789518222.570316:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518222.570523:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501671808 00000100:00100000:2.0:1789518222.570534:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501671808 00000100:00100000:2.0:1789518222.570595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00100000:2.0:1789518222.570607:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+61:12323:x1876445501671808:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518222.570630:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518222.570650:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566352 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.570711:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.570725:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.570736:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518222.570775:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789518222.570778:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518222.570794:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.570817:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942314e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566352 expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.570834:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566352 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.570876:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:2.0:1789518222.570880:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518222.570883:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ade00, rc 0) 00000100:00100000:2.0:1789518222.571385:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+62:12323:x1876445501671808:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 779us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518222.571393:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00100000:1.0:1789518222.588532:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.588634:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501672192 00000100:00100000:0.0:1789518222.588646:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501672192 00000100:00100000:0.0:1789518222.588709:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:0.0:1789518222.588720:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+62:12323:x1876445501672192:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518222.589014:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+63:12323:x1876445501672192:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 294us (489us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789518222.589021:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:1.0:1789518222.599839:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518222.600001:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501672320 00000100:00100000:2.0:1789518222.600013:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501672320 00000100:00100000:2.0:1789518222.600077:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:2.0:1789518222.600087:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+63:12323:x1876445501672320:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:2.0:1789518222.600101:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518222.600124:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314dfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566336 expref: 63 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.600145:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856634b expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.600159:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314cfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662f0 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518222.600169:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518222.600174:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518222.600234:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+60:12323:x1876445501672320:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 149us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518222.600241:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:1.0:1789518222.610761:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.611075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501672448 00000100:00100000:0.0:1789518222.611086:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501672448 00000100:00100000:0.0:1789518222.611161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 183 00000100:00100000:0.0:1789518222.611171:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+60:12323:x1876445501672448:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:0.0:1789518222.611297:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.611314:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.611327:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518222.611418:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789518222.611515:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+60:12323:x1876445501672448:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 345us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518222.611522:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 183 00000040:00080000:0.0:1789518222.646563:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789518222.668556:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518222.668924:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501672576 00000100:00100000:0.0:1789518222.668935:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501672576 00000100:00100000:0.0:1789518222.668999:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 184 00000100:00100000:0.0:1789518222.669009:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+60:12325:x1876445501672576:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518222.669028:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518222.669047:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566359 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669124:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669138:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669149:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669159:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669166:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669172:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669249:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669260:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669266:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518222.669306:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789518222.669310:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518222.669326:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669347:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669356:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669363:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669370:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669376:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518222.669381:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669389:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669401:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518222.669404:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518222.669408:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669415:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314e83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669426:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669432:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669443:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669449:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518222.669452:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669458:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669511:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:0.0:1789518222.669513:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518222.669517:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669523:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669550:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 62 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669563:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 61 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518222.669570:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518222.669572:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518222.669575:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7a00, rc 0) 00000100:00100000:0.0:1789518222.669647:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+61:12325:x1876445501672576:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 639us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518222.669662:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 184 00000040:00080000:2.0:1789518223.286202:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518223.286211:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518223.286255:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789518223.286265:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518223.286405:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73031e7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522708480:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518223.286552:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518223.295277:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.295339:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501672704 00000100:00100000:1.0:1789518223.295349:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501672704 00000100:00100000:1.0:1789518223.295418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 185 00000100:00100000:1.0:1789518223.295427:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+62:12336:x1876445501672704:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518223.295479:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1789518223.295640:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518223.296109:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73031e7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522708480:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518223.296497:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+61:12336:x1876445501672704:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 1068us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.296508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 185 00000100:00100000:2.0:1789518223.306259:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518223.306391:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501672832 00000100:00100000:0.0:1789518223.306401:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501672832 00000100:00100000:0.0:1789518223.306567:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 186 00000100:00100000:0.0:1789518223.306587:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+61:12336:x1876445501672832:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789518223.306662:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.306680:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.307559:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.307628:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.307638:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.307645:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.307676:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.308839:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.308878:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518223.308934:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789518223.308939:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518223.308952:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.308965:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.308972:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.308979:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.308985:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518223.308989:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.308998:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309011:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:0.0:1789518223.309015:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518223.309020:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309026:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942314e98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309051:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309057:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309064:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309070:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518223.309072:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309078:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309084:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8e7303359600) 00010000:00010000:0.0:1789518223.309086:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518223.309089:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309094:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942314e9f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309110:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309115:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309120:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309130:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518223.309133:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309138:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309146:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:0.0:1789518223.309148:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518223.309151:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.309156:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942314ea6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.309268:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+61:12336:x1876445501672832:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 2688us (3014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.309278:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 186 00000100:00100000:1.0:1789518223.322492:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.324006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501673088 00000100:00100000:3.0:1789518223.324018:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501673088 00000100:00100000:3.0:1789518223.324109:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:3.0:1789518223.324120:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+61:12336:x1876445501673088:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518223.324140:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518223.324160:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314ead lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566360 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324259:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324273:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324294:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518223.324305:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789518223.324374:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324381:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324387:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324392:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcfa00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518223.324396:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324403:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324413:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518223.324416:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518223.324420:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324426:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcfa00/0x8d0fd67942314eb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324460:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314ead lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566360 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324506:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:3.0:1789518223.324509:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518223.324513:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314ead lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566360 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.324522:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435dcf400, rc 0) 00000100:00100000:3.0:1789518223.324598:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+62:12336:x1876445501673088:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 479us (2146us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1789518223.324607:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:2.0:1789518223.329664:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.335889:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501673216 00000100:00100000:1.0:1789518223.335902:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501673216 00000100:00100000:1.0:1789518223.336247:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:1.0:1789518223.336267:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+62:12336:x1876445501673216:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518223.336303:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518223.338152:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+62:12336:x1876445501673216:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 1879us (8488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.338166:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:3.0:1789518223.343672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.343709:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501673472 00000100:00100000:3.0:1789518223.343719:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501673472 00000100:00100000:3.0:1789518223.343783:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:3.0:1789518223.343834:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+62:12336:x1876445501673472:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518223.343858:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518223.343861:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518223.343888:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942314e6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566352 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.343907:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518223.343913:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518223.343927:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314ec2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566367 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518223.344350:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789518223.345531:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd67942314ec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.345551:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd67942314ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.345564:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd67942314ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.345646:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf400/0x8d0fd67942314ec2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566367 expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.345664:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd67942314ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566367 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.345672:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:2.0:1789518223.345674:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518223.345677:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad400, rc 0) 00000100:00100000:2.0:1789518223.345744:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+63:12336:x1876445501673472:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1914us (2082us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789518223.345762:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:3.0:1789518223.350297:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.350334:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501673728 00000100:00100000:3.0:1789518223.350342:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501673728 00000100:00100000:3.0:1789518223.350391:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:3.0:1789518223.350397:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+63:12336:x1876445501673728:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518223.350447:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518223.350489:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad400/0x8d0fd67942314ec9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566367 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350501:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e73010b5000) 00010000:00010000:3.0:1789518223.350509:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518223.350531:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350545:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350554:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350599:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350607:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350614:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350655:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350666:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350671:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350676:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518223.350679:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350684:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350690:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518223.350692:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518223.350695:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350700:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314ed7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350707:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350711:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350715:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350718:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518223.350723:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350727:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350731:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4a0e8925 (ffff8e7435d04900) 00010000:00010000:3.0:1789518223.350733:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518223.350734:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.350737:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314ede lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4a0e8925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.350800:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+62:12336:x1876445501673728:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 402us (511us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518223.350805:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:3.0:1789518223.353572:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.354828:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501673856 00000100:00100000:1.0:1789518223.354843:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501673856 00000100:00100000:1.0:1789518223.354912:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:1.0:1789518223.355128:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+62:12336:x1876445501673856:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518223.355149:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518223.355173:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314ee5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856636e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.355209:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.355223:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.355235:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.355356:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942314ee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.355373:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.355393:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:1.0:1789518223.355396:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518223.355399:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c800, rc 0) 00000100:00100000:1.0:1789518223.355481:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+63:12336:x1876445501673856:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 339us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.355489:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:3.0:1789518223.360694:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.360863:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501674112 00000100:00100000:1.0:1789518223.360875:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501674112 00000100:00100000:1.0:1789518223.360935:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 192 00000100:00100000:1.0:1789518223.360959:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+63:12336:x1876445501674112:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518223.361042:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.361071:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.361082:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518223.361247:0:8781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789518223.361257:0:8781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391146791897ns, next at 392146789710ns, rc = 0 00000004:00010000:1.0:1789518223.361299:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000812575a3 reply state 00000000059ded5f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.361313:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.361321:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:1.0:1789518223.361351:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789518223.361355:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518223.361459:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+65:12336:x1876445501674112:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 515us (774us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789518223.361493:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 192 00000100:00100000:2.0:1789518223.364518:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.364714:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501674240 00000100:00100000:3.0:1789518223.364723:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501674240 00000100:00100000:1.0:1789518223.364859:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:1.0:1789518223.364871:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+65:12336:x1876445501674240:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518223.364895:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518223.364913:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566375 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.364979:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.364995:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.365013:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:1.0:1789518223.365017:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518223.365020:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0cc00, rc 0) 00000100:00100000:1.0:1789518223.365102:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+66:12336:x1876445501674240:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 234us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.365109:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:3.0:1789518223.368217:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.368395:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501674368 00000100:00100000:1.0:1789518223.368407:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501674368 00000100:00080000:3.0:1789518223.368452:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518223.368511:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:1.0:1789518223.368522:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+6:2388:x1876445501674368:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789518223.368834:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501674368:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 314us (623us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789518223.368843:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:3.0:1789518223.371114:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.371364:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501674624 00000100:00100000:1.0:1789518223.371374:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501674624 00000100:00100000:1.0:1789518223.371427:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:1.0:1789518223.371437:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+66:12336:x1876445501674624:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518223.371712:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+67:12336:x1876445501674624:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 275us (602us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789518223.371720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:2.0:1789518223.385899:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.385944:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501674880 00000100:00100000:3.0:1789518223.385953:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501674880 00000100:00100000:3.0:1789518223.386007:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00100000:3.0:1789518223.386015:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+67:12336:x1876445501674880:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789518223.386111:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+67:12336:x1876445501674880:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.386124:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00100000:3.0:1789518223.390172:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518223.390436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501675008 00000100:00100000:2.0:1789518223.390445:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501675008 00000100:00100000:2.0:1789518223.390542:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 195 00000100:00100000:2.0:1789518223.390552:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+67:12336:x1876445501675008:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518223.390571:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518223.390602:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314f01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856637c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.390686:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314f08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.390713:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.390725:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518223.391662:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518223.391710:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.391743:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314f01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856637c expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.391759:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314f08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856637c expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.391788:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:2.0:1789518223.391792:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518223.391795:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac600, rc 0) 00000100:00100000:2.0:1789518223.391864:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+68:12336:x1876445501675008:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1312us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.391872:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 195 00000100:00100000:2.0:1789518223.397534:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518223.399384:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501675136 00000100:00100000:0.0:1789518223.399397:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501675136 00000100:00100000:0.0:1789518223.399453:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789518223.399481:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501675136:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518223.399499:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518223.399518:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566383 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518223.399541:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e18f, blocks: 0x0 00010000:00010000:0.0:1789518223.399560:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1789518223.399573:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518223.399593:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.399614:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.399628:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7000, rc 0) 00000100:00100000:0.0:1789518223.399691:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7301965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501675136:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 229us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.399699:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:3.0:1789518223.402367:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.402498:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501675392 00000100:00100000:1.0:1789518223.402507:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501675392 00000100:00100000:1.0:1789518223.402564:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 196 00000100:00100000:1.0:1789518223.402583:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+68:12336:x1876445501675392:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518223.402689:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+68:12336:x1876445501675392:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 116us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.402909:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 196 00000100:00100000:0.0:1789518223.407688:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.407766:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501675520 00000100:00100000:3.0:1789518223.407777:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501675520 00000100:00100000:3.0:1789518223.407831:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:3.0:1789518223.407842:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+8:12336:x1876445501675520:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518223.407862:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518223.407880:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856638a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.407909:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.407918:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518223.407922:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518223.407927:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.407958:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.407970:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 9 pid: 8428 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.407984:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1876445522708608:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518223.408092:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410ba9d80 going to sleep for 11 seconds 00010000:00010000:3.0:1789518223.414543:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518223.415605:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1876445522708608:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518223.415641:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.415661:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031800, rc 0) 00000100:00100000:2.0:1789518223.415721:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+9:12336:x1876445501675520:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 7882us (8044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.415730:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:3.0:1789518223.418936:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518223.419027:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501675648 00000100:00100000:2.0:1789518223.419038:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501675648 00010000:00010000:2.0:1789518223.419084:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 9 pid: 8428 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518223.419125:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:2.0:1789518223.419136:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501675648:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518223.419150:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518223.419185:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 9 pid: 8428 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.419213:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 9 pid: 8428 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.419239:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942314f0f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566383 expref: 9 pid: 8428 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.419255:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518223.419260:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518223.419268:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.419277:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.419316:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518223.419332:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1876445522708736:192.168.202.43@tcp:105: 00000100:00100000:2.0:1789518223.419408:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518223.427068:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518223.427149:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6498:1876445522708736:192.168.202.43@tcp:105: 00010000:00010000:2.0:1789518223.427175:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518223.427231:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501675648:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 8097us (8301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.427242:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:1.0:1789518223.434492:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501675776 00000100:00100000:1.0:1789518223.434507:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501675776 00002000:00100000:1.0:1789518223.434558:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8e7303d63100 x1876445501675776/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:624/0 lens 504/0 e 0 to 0 dl 1789518234 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518223.434570:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303d63100 with x1876445501675776 ext(0->8) 00002000:00010000:1.0:1789518223.434585:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303d63100 00000100:00100000:1.0:1789518223.434660:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:1.0:1789518223.434670:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501675776:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518223.444237:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+10:2388:x1876445501675776:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 9557us (17166us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789518223.444251:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00002000:00100000:1.0:1789518223.444264:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8e7303d63100 x1876445501675776/t4294967315(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:624/0 lens 504/448 e 0 to 0 dl 1789518234 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518223.444275:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303d63100 with x1876445501675776 ext(0->8) 00002000:00010000:1.0:1789518223.444281:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303d63100 00000100:00100000:3.0:1789518223.453454:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.455810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501675904 00000100:00100000:1.0:1789518223.455828:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501675904 00000100:00100000:3.0:1789518223.458441:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 197 00000100:00100000:3.0:1789518223.458497:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+68:12336:x1876445501675904:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518223.462514:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1789518223.462532:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1789518223.462554:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1789518223.462607:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789518223.462617:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e7435e66840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789518223.462622:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7418af8600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e7435e660c0 00000020:00080000:3.0:1789518223.462625:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7418af8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e73036b1a00 00000020:00080000:3.0:1789518223.462768:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789518223.462820:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789518223.462937:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+24:12336:x1876445501675904:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 4478us (9488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.462948:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 197 00000100:00100000:1.0:1789518223.468080:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522708864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518223.468156:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.468220:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518223.468229:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522708992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518223.468265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.468309:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522708864 00000100:00100000:1.0:1789518223.468317:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522708864 00000100:00100000:1.0:1789518223.468362:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522708992 00000100:00100000:1.0:1789518223.468365:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522708992 00000100:00100000:1.0:1789518223.468388:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518223.468396:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522708864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789518223.468555:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789518223.468559:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789518223 00002000:00010000:1.0:1789518223.468561:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789518223.468563:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789518223 -> 1789518223 00002000:00010000:1.0:1789518223.468566:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789518223.468614:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522708864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (457us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789518223.468630:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518223.468646:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789518223.468652:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522708992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789518223.468667:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1789518223.468692:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa9e18b, atime: 0x6aa9e18b, ctime: 0x6aa9e18b, blocks: 0x8 00010000:00010000:1.0:1789518223.468700:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.468715:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1789518223.468720:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518223.468727:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.468743:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.468753:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.468760:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.468783:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518223.468876:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522708992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 223us (609us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789518223.468883:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1789518223.468910:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518223.468914:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789518223.468951:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7303db6680/2, rc 0, transno 4294967308 00000100:00100000:1.0:1789518223.468957:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522708992:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789518223.468969:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7303db6300/2, rc 0, transno 4294967316 00000100:00100000:1.0:1789518223.468972:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522708864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518223.470395:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.470460:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501676032 00000100:00100000:3.0:1789518223.470502:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501676032 00000100:00100000:3.0:1789518223.470546:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:3.0:1789518223.470556:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+10:2388:x1876445501676032:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789518223.471049:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471061:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471069:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471075:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518223.471079:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471088:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471102:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441628d00) 00010000:00010000:2.0:1789518223.471105:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518223.471109:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471115:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c000/0x8d0fd67942314c84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471141:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471148:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471154:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471170:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0dc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518223.471174:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471180:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471188:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518223.471190:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518223.471193:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471199:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942314d87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471212:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471217:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471223:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471228:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518223.471230:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471236:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471258:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518223.471261:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518223.471264:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471269:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942314daa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471281:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471287:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471293:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471297:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518223.471300:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471306:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471313:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518223.471316:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518223.471318:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471324:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942314df0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471345:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471351:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471357:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471362:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0ca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518223.471365:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471370:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471378:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:2.0:1789518223.471380:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518223.471383:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471389:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd67942314ef3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471405:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518223.471411:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471421:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518223.471424:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471438:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471450:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.471457:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd67942314f1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.472133:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518223.472136:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518223.472138:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789518223.476965:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1789518223.476982:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789518223.477435:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501676032:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 6874us (7037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.477447:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:3.0:1789518223.483662:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518223.483816:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501676288 00000100:00100000:0.0:1789518223.483828:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501676288 00000100:00100000:0.0:1789518223.483886:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 198 00000100:00100000:0.0:1789518223.483897:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:12336:x1876445501676288:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518223.483972:0:8781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518223.484002:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac600/0x8d0fd67942314f08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856637c expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.484023:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:0.0:1789518223.484029:0:8781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518223.484061:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.484076:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.484100:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518223.484224:0:8781:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a93f7f6 reply state 00000000b5f41f06 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.484237:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.484244:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:0.0:1789518223.484246:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518223.484249:0:8781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518223.484351:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+20:12336:x1876445501676288:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 454us (698us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789518223.484358:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 198 00000100:00100000:1.0:1789518223.488705:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518223.490125:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501676416 00000100:00100000:2.0:1789518223.490137:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501676416 00000100:00100000:2.0:1789518223.490238:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789518223.490250:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501676416:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518223.490418:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789518223.490421:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789518223 -> 1789518222 00002000:00010000:2.0:1789518223.490424:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789518219 00002000:00010000:2.0:1789518223.490426:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789518223 -> 1789518222 00002000:00010000:2.0:1789518223.490429:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789518223.490709:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73036dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501676416:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 460us (2010us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789518223.490717:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789518223.499306:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.499398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501676672 00000100:00100000:3.0:1789518223.499409:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501676672 00000100:00100000:3.0:1789518223.499729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 199 00000100:00100000:3.0:1789518223.499742:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+20:12336:x1876445501676672:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789518223.499814:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.499834:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.499846:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.499884:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.499896:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 20 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.499910:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522709120:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518223.500058:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410ba9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518223.506031:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522709120:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518223.506066:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518223.507252:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.507331:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501676800 00000100:00100000:3.0:1789518223.507341:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501676800 00010000:00010000:3.0:1789518223.507381:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 21 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.507423:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00100000:3.0:1789518223.507433:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+21:2387:x1876445501676800:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518223.507454:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518223.507492:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 21 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507508:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 21 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507530:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942314eec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856636e expref: 21 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507546:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:3.0:1789518223.507552:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507562:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507570:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507605:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518223.507659:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+20:2387:x1876445501676800:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 227us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.507682:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 86 00010000:00010000:3.0:1789518223.507765:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507774:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507826:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507834:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507840:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507846:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518223.507850:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507858:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507867:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:3.0:1789518223.507870:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518223.507874:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.507881:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f2b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.507929:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+19:12336:x1876445501676672:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 8190us (8631us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518223.507937:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 199 00000100:00100000:0.0:1789518223.527876:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.528102:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501676928 00000100:00100000:3.0:1789518223.528112:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501676928 00000100:00100000:3.0:1789518223.528175:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:3.0:1789518223.528195:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501676928:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518223.529033:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.529057:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.529067:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518223.529071:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518223.529076:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.529115:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.529130:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 8 pid: 8427 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.529145:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13804:1876445522709248:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518223.529234:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410ba9d80 going to sleep for 11 seconds 00000040:00080000:2.0:1789518223.533879:0:14603:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518223.533889:0:14603:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518223.533915:0:14603:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789518223.533922:0:14603:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789518223.544032:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518223.544099:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501677056 00000100:00100000:2.0:1789518223.544108:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501677056 00010000:00010000:2.0:1789518223.544150:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 9 pid: 8427 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518223.544192:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:2.0:1789518223.544202:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740973ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501677056:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518223.544217:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518223.544239:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 9 pid: 8427 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.544253:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 9 pid: 8427 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.544276:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518223.544281:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518223.544287:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.544315:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.544337:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518223.544393:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740973ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501677056:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 192us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.544401:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 87 00010000:00010000:0.0:1789518223.544611:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a59de57/0x8d0fd67942314f16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856638a expref: 8 pid: 8427 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.544626:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7404810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13804:1876445522709248:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518223.544648:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544658:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544665:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544693:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544701:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544711:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544718:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518223.544723:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544732:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544744:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.544752:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd67942314f32 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.544796:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501676928:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 16604us (16930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.544811:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:3.0:1789518223.551902:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518223.552325:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501677312 00000100:00100000:1.0:1789518223.552336:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501677312 00000100:00100000:1.0:1789518223.552395:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 200 00000100:00100000:1.0:1789518223.552404:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+19:12336:x1876445501677312:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518223.552488:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.552506:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 19 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.552516:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.552548:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 19 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.552561:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 19 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518223.552602:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522709376:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518223.552682:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74012edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518223.556583:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522709376:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518223.556614:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.562711:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.562787:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501677440 00000100:00100000:3.0:1789518223.562798:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501677440 00010000:00010000:3.0:1789518223.562838:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 20 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.562959:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:3.0:1789518223.562969:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+20:2387:x1876445501677440:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518223.562984:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518223.562991:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 20 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.563004:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 20 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.563024:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435dcf600/0x8d0fd67942314d80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566313 expref: 20 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.563039:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:3.0:1789518223.563044:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.563054:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.563062:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.563101:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518223.563124:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.563136:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.563183:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+19:2387:x1876445501677440:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 215us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.563192:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 88 00010000:00010000:1.0:1789518223.563320:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.563334:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.563343:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.563385:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.563399:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 19 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518223.563412:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522709504:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518223.563486:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74012edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518223.567775:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522709504:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789518223.567810:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.574906:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518223.574976:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501677568 00000100:00100000:2.0:1789518223.574987:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501677568 00010000:00010000:2.0:1789518223.575029:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 20 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518223.575077:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:2.0:1789518223.575088:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+20:2388:x1876445501677568:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518223.575106:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518223.575113:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 20 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.575133:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 20 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.575156:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942314efa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566375 expref: 20 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.575187:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:2.0:1789518223.575193:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.575201:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.575207:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.575236:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518223.575284:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+19:2388:x1876445501677568:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 200us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.575290:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 89 00010000:00010000:0.0:1789518223.575394:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.575403:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518223.575531:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789518223.575665:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789518223.575701:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789518223.575783:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303559f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522709632:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789518223.575834:0:8781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518223.575860:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74053dd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518223.576242:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522709632 00000100:00100000:2.0:1789518223.576249:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522709632 00000100:00100000:2.0:1789518223.576291:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789518223.576298:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8781:x1876445522709632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518223.576380:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8781:x1876445522709632:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.576395:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789518223.576428:0:8781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1789518223.576436:0:8781:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7303db6300, transno 4294967316 00000100:00100000:1.0:1789518223.576458:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303559f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522709632:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789518223.576600:0:8781:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1789518223.576645:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522709760:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518223.576677:0:8781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.576703:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f256c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518223.576735:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522709760 00000100:00100000:3.0:1789518223.576748:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522709760 00000100:00100000:3.0:1789518223.576781:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789518223.576788:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8781:x1876445522709760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789518223.576899:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8781:x1876445522709760:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (221us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789518223.576906:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789518223.576981:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8781:1876445522709760:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789518223.577012:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577021:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577030:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577035:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518223.577041:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577049:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577062:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:1.0:1789518223.577064:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518223.577069:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577085:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd67942314f40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577109:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577115:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577120:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577138:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518223.577141:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577146:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577154:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:1.0:1789518223.577156:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518223.577159:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577164:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942314e75 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577186:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577199:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 22 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577215:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577240:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 22 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.577252:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 22 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518223.577263:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730379e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522709888:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518223.577326:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518223.591188:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730379e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522709888:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518223.591220:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518223.591403:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518223.591509:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501677696 00000100:00100000:2.0:1789518223.591517:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501677696 00010000:00010000:2.0:1789518223.591555:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 23 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518223.591602:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 90 00000100:00100000:2.0:1789518223.591612:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+23:2388:x1876445501677696:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518223.591635:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518223.591642:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 23 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.591655:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 23 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.591676:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942314e91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566359 expref: 23 pid: 8781 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.591689:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:2.0:1789518223.591694:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.591705:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.591713:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.591731:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518223.591780:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+22:2388:x1876445501677696:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 169us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.591788:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 90 00010000:00010000:1.0:1789518223.592117:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.592132:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.592146:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.592153:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.592160:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.592166:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518223.594823:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594863:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594881:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:1.0:1789518223.594884:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518223.594890:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594898:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd67942314f47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594918:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594925:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594933:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594939:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518223.594943:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594950:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594959:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04a00) 00010000:00010000:1.0:1789518223.594961:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518223.594964:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.594980:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942314f39 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.595258:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+21:12336:x1876445501677312:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 42849us (43360us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789518223.595270:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 200 00000020:00080000:0.0:1789518223.595276:0:8781:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789518223.595695:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518223.595700:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518223.596443:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789518223.596456:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518223.617901:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518223.617965:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501677952 00000100:00100000:3.0:1789518223.617977:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501677952 00000100:00100000:3.0:1789518223.618032:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:3.0:1789518223.618042:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+21:12336:x1876445501677952:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789518223.618415:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518223.618447:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789518223.618617:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.618633:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.618646:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.618655:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.618661:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.618669:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.618690:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518223.618826:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+23:12336:x1876445501677952:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 783us (933us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789518223.618835:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000020:00080000:3.0:1789518223.618840:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789518223.619032:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518223.619040:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.619047:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518223.619058:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.619067:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.619080:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:0.0:1789518223.619083:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789518223.619088:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.619095:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.619107:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518223.619109:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518223.619111:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518224.437615:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518224.888150:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522710016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518224.888331:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518224.888505:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522710016 00000100:00100000:3.0:1789518224.888514:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522710016 00000100:00100000:3.0:1789518224.888587:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789518224.888597:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522710016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518224.888626:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789518224.888679:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518224.889780:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522710016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518224.889843:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522710016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1245us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518224.889853:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789518225.306280:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.306318:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.306350:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.306368:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.306383:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.306400:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.306421:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.306446:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501678464 00000100:00100000:3.0:1789518225.306455:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501678464 00000100:00100000:3.0:1789518225.306526:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501678592 00000100:00100000:3.0:1789518225.306529:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501678592 00000100:00100000:3.0:1789518225.306551:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:3.0:1789518225.306574:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501678464:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518225.306637:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73031e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501678464:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518225.306659:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:3.0:1789518225.306674:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:3.0:1789518225.306680:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501678592:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518225.306701:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501678592:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 22us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518225.306707:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:3.0:1789518225.306722:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501678208 00000100:00100000:3.0:1789518225.306725:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501678208 00000100:00100000:3.0:1789518225.306742:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501678720 00000100:00100000:3.0:1789518225.306744:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501678720 00000100:00100000:3.0:1789518225.306753:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501678336 00000100:00100000:3.0:1789518225.306755:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501678336 00000100:00100000:3.0:1789518225.306766:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501678848 00000100:00100000:3.0:1789518225.306767:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501678848 00000100:00100000:3.0:1789518225.306780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 329 00000100:00100000:3.0:1789518225.306785:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+23:2387:x1876445501678208:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518225.306812:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+23:2387:x1876445501678208:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518225.306818:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 329 00000100:00100000:3.0:1789518225.306828:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 330 00000100:00100000:3.0:1789518225.306834:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501678720:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518225.306853:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73035bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501678720:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 19us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518225.306858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 330 00000100:00100000:3.0:1789518225.306868:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 331 00000100:00100000:3.0:1789518225.306879:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501678336:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518225.306898:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501678336:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 20us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518225.306903:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 331 00000100:00100000:3.0:1789518225.306913:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 332 00000100:00100000:3.0:1789518225.306918:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501678848:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518225.306934:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7302abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501678848:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 16us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518225.306939:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 332 00000100:00080000:3.0:1789518225.306961:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518225.306964:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518225.306967:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518225.306968:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518225.308368:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501678080 00000100:00100000:1.0:1789518225.308380:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501678080 00000100:00100000:1.0:1789518225.308431:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 389 00000100:00100000:1.0:1789518225.308439:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501678080:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518225.308509:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501678080:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 70us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518225.308516:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 389 00010000:00010000:1.0:1789518225.461639:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518225.756528:0:14654:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518225.756538:0:14654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518225.756576:0:14654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789518225.756585:0:14654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518225.942323:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.942599:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501679104 00000100:00100000:3.0:1789518225.942610:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501679104 00000100:00100000:3.0:1789518225.942669:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:3.0:1789518225.942679:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+23:12354:x1876445501679104:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518225.942699:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518225.942721:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566391 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.942822:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.942837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.942849:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518225.942872:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789518225.942969:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942314f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566391 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.942984:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566391 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.942993:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518225.942996:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518225.943000:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:3.0:1789518225.943053:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+25:12354:x1876445501679104:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 375us (740us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789518225.943059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:3.0:1789518225.949392:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518225.949431:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501679232 00000100:00100000:3.0:1789518225.949440:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501679232 00000100:00100000:3.0:1789518225.949509:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:3.0:1789518225.949518:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+25:12354:x1876445501679232:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:3.0:1789518225.949618:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949635:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949648:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949663:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949680:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949686:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949755:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949763:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949770:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518225.949815:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949828:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949835:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949842:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949848:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518225.949852:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949860:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949879:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518225.949882:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518225.949887:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949893:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942314f6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949907:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949913:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949920:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949925:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518225.949929:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949935:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949943:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518225.949945:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518225.949949:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949954:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942314f71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949978:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949983:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949989:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.949994:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518225.949997:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.950004:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.950011:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518225.950013:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518225.950016:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518225.950022:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518225.950094:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+25:12354:x1876445501679232:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 576us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518225.950102:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:3.0:1789518226.040980:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.041013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501679488 00000100:00100000:3.0:1789518226.041022:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501679488 00000100:00100000:3.0:1789518226.041095:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:3.0:1789518226.041106:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+25:12357:x1876445501679488:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518226.041126:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518226.041145:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566398 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.041217:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.041232:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.041245:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.041258:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.041265:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.041272:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042521:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042536:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042546:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518226.042582:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789518226.042660:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042667:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042674:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042680:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.042684:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042692:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042705:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518226.042708:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.042713:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042720:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314f86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042732:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042738:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042753:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042758:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165ce00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.042761:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042767:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042775:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518226.042778:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.042781:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042787:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314f8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042829:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314f7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042844:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.042851:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.042854:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518226.042856:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740165de00, rc 0) 00000100:00100000:3.0:1789518226.042917:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+27:12357:x1876445501679488:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1812us (1945us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789518226.042934:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:0.0:1789518226.056233:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518226.056695:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501679616 00000100:00100000:2.0:1789518226.056706:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501679616 00000100:00100000:2.0:1789518226.056772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 204 00000100:00100000:2.0:1789518226.056781:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:12357:x1876445501679616:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789518226.056843:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056861:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056874:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056907:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056913:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056919:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056926:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033acc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518226.056930:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056938:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056949:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:2.0:1789518226.056953:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518226.056957:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.056972:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518226.057036:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:12357:x1876445501679616:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 256us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518226.057043:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 204 00000100:00100000:2.0:1789518226.063164:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518226.063226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501679872 00000100:00100000:1.0:1789518226.063238:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501679872 00000100:00100000:1.0:1789518226.063300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:1.0:1789518226.063310:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+27:12357:x1876445501679872:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789518226.063535:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+28:12357:x1876445501679872:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 225us (378us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789518226.063543:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:3.0:1789518226.132100:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518226.132343:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501680128 00000100:00100000:2.0:1789518226.132355:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501680128 00000100:00100000:2.0:1789518226.132415:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 205 00000100:00100000:2.0:1789518226.132427:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+28:11882:x1876445501680128:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518226.132453:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518226.132511:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856639f expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.132628:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.132644:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.132655:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.132685:0:8781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.132699:0:8781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 29 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518226.132727:0:8781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e730373aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522710144:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518226.132812:0:8781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518226.136061:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.136256:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501680256 00000100:00100000:0.0:1789518226.136266:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501680256 00010000:00010000:0.0:1789518226.136315:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 30 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518226.136355:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:0.0:1789518226.136366:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+30:2388:x1876445501680256:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518226.136394:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518226.136401:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 30 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.136415:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 30 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.136443:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:0.0:1789518226.136449:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.136459:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.136502:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.136523:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518226.136586:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+30:2388:x1876445501680256:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 221us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518226.136593:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 91 00010000:00010000:3.0:1789518226.137034:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314f94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566398 expref: 29 pid: 6513 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518226.137055:0:8781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e730373aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8781:1876445522710144:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518226.137076:0:8781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.137085:0:8781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.137090:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518226.137107:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789518226.137259:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942314fa9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 30 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.137276:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 29 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.137285:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.137287:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518226.137290:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad000, rc 0) 00000100:00100000:3.0:1789518226.137331:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+29:11882:x1876445501680128:12345-192.168.202.43@tcp:101:bash.0 Request processed in 4906us (5240us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789518226.137338:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 205 00000100:00100000:2.0:1789518226.141189:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.141280:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501680384 00000100:00100000:3.0:1789518226.141290:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501680384 00000100:00100000:3.0:1789518226.141354:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 206 00000100:00100000:3.0:1789518226.141364:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+29:11882:x1876445501680384:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518226.141388:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518226.141406:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.141439:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314fc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.141453:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.141497:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.141632:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663a6 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.141653:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663a6 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.141661:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.141664:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518226.141667:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740165ce00, rc 0) 00000100:00100000:3.0:1789518226.141723:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+30:11882:x1876445501680384:12345-192.168.202.43@tcp:101:bash.0 Request processed in 361us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518226.141730:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 206 00000100:00100000:0.0:1789518226.147937:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.148056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501680640 00000100:00100000:3.0:1789518226.148065:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501680640 00000100:00100000:3.0:1789518226.148126:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 207 00000100:00100000:3.0:1789518226.148135:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+30:11882:x1876445501680640:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:3.0:1789518226.148363:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.148381:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.148394:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518226.148433:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789518226.148455:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085841c28 reply state 000000005dd626aa transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.148492:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.148499:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.148502:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518226.148506:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789518226.148544:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789518226.148646:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+34:11882:x1876445501680640:12345-192.168.202.43@tcp:36:bash.0 Request processed in 511us (717us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789518226.148654:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 207 00000020:00080000:3.0:1789518226.148658:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789518226.156963:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.157044:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501680768 00000100:00100000:3.0:1789518226.157055:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501680768 00000100:00100000:3.0:1789518226.157116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 208 00000100:00100000:3.0:1789518226.157140:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+34:11882:x1876445501680768:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518226.157176:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518226.157197:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314fd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663ad expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.157262:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663ad expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.157278:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663ad expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.157306:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.157309:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518226.157313:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740165d400, rc 0) 00000100:00100000:3.0:1789518226.157367:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+35:11882:x1876445501680768:12345-192.168.202.43@tcp:101:bash.0 Request processed in 229us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518226.157374:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 208 00000100:00100000:1.0:1789518226.159743:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.159830:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501680896 00000100:00100000:0.0:1789518226.159839:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501680896 00000100:00100000:0.0:1789518226.159893:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:0.0:1789518226.159902:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:11882:x1876445501680896:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518226.159918:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518226.159952:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663b4 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518226.159978:0:13804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa9e18e, atime: 0x6aa9e18b, ctime: 0x6aa9e18e, blocks: 0x8 00010000:00010000:0.0:1789518226.159998:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1789518226.160003:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518226.160012:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 8 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.160028:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 8 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.160041:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6a00, rc 0) 00000100:00100000:0.0:1789518226.160095:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+8:11882:x1876445501680896:12345-192.168.202.43@tcp:101:bash.0 Request processed in 194us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518226.160102:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:0.0:1789518226.161888:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518226.161977:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501681024 00000100:00100000:2.0:1789518226.161986:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501681024 00002000:00010000:2.0:1789518226.162025:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789518226.162029:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7435e91880 with x1876445501681024 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518226.162039:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7435e91880. 00000100:00100000:2.0:1789518226.162067:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:2.0:1789518226.162076:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+8:2389:x1876445501681024:12345-192.168.202.43@tcp:10:bash.0 00002000:00010000:2.0:1789518226.162343:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789518226.162346:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789518222 -> 1789518226 00002000:00010000:2.0:1789518226.162349:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789518219 -> 1789518219 00002000:00010000:2.0:1789518226.162352:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789518222 -> 1789518226 00002000:00010000:2.0:1789518226.162354:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789518226.162408:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5499dd84-083f-4a57-a16b-aad857025063+9:2389:x1876445501681024:12345-192.168.202.43@tcp:10:bash.0 Request processed in 333us (525us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789518226.162416:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00002000:00010000:2.0:1789518226.162420:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789518226.162422:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7435e91880 with x1876445501681024 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518226.162426:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7435e91880. 00000100:00100000:1.0:1789518226.328596:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.328704:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501681152 00000100:00100000:3.0:1789518226.328715:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501681152 00000100:00100000:3.0:1789518226.328777:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 209 00000100:00100000:3.0:1789518226.328788:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+35:12371:x1876445501681152:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:3.0:1789518226.328858:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.328877:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.328890:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.328910:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.328918:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.328925:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.328991:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329001:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329008:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518226.329049:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329060:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329067:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329074:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329080:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.329085:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329098:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329109:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518226.329112:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.329117:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329124:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942314fe1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329139:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329145:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329151:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329156:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.329159:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329165:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329172:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7435d04d00) 00010000:00010000:3.0:1789518226.329175:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.329178:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329192:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314fe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329207:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329213:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329232:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329237:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165c400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.329240:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329246:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329254:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.329256:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.329258:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.329264:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314fef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518226.329343:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+35:12371:x1876445501681152:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 556us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518226.329350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 209 00000100:00100000:1.0:1789518226.406411:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.406697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501681408 00000100:00100000:3.0:1789518226.406707:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501681408 00000100:00100000:3.0:1789518226.406763:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 210 00000100:00100000:3.0:1789518226.406774:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+35:12374:x1876445501681408:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518226.406793:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518226.406814:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314ff6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663bb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.406886:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.406901:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.406913:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.406927:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.406935:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.406941:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407035:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd6794231500b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407044:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd6794231500b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407070:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd6794231500b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518226.407080:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789518226.407150:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407158:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407165:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407171:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.407176:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407184:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407196:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518226.407200:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.407205:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407212:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd67942314ffd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407238:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407245:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407256:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407261:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.407265:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407271:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407280:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7435d04500) 00010000:00010000:3.0:1789518226.407283:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.407286:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407426:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315004 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407609:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942314ff6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663bb expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407627:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd6794231500b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663bb expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.407635:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.407637:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789518226.407640:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740165c200, rc 0) 00000100:00100000:2.0:1789518226.407772:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+37:12374:x1876445501681408:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 999us (1368us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789518226.407792:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 210 00000100:00100000:2.0:1789518226.416917:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.416995:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501681536 00000100:00100000:3.0:1789518226.417005:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501681536 00000100:00100000:3.0:1789518226.417074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:3.0:1789518226.417084:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+37:12374:x1876445501681536:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:3.0:1789518226.417160:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.417176:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 37 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.417186:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.417228:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 37 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.417242:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 37 pid: 8781 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518226.417257:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522710272:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518226.417358:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518226.420279:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518226.420454:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501681792 00000100:00100000:1.0:1789518226.420486:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501681792 00000100:00100000:1.0:1789518226.420542:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:1.0:1789518226.420562:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+38:6160:x1876445501681792:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789518226.420839:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+39:6160:x1876445501681792:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 288us (567us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789518226.420848:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:3.0:1789518226.421179:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522710272:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518226.421206:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518226.422779:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522710784:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.422833:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.422859:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522711296:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.422878:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.422892:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522711808:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.422911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.422930:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789518226.422936:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522710400:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.422961:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.422984:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522710912:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.423006:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.423021:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522711424:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.423040:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.423051:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522711936:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.423067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.423093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522710784 00000100:00100000:2.0:1789518226.423100:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522710784 00000100:00100000:2.0:1789518226.423132:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711296 00000100:00100000:2.0:1789518226.423134:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711296 00000100:00100000:2.0:1789518226.423156:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789518226.423164:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522710784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.423206:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522710784:12345-0@lo:400:kworker.0 Request processed in 43us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518226.423239:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789518226.423256:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789518226.423261:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522711296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.423288:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522711296:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518226.423657:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522710400 00000100:00100000:0.0:1789518226.423663:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522710400 00000100:00100000:0.0:1789518226.423689:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1789518226.423696:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522710400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518226.423729:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522710400:12345-0@lo:400:kworker.0 Request processed in 34us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518226.423735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1789518226.423760:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522710912 00000100:00100000:0.0:1789518226.423763:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522710912 00000100:00100000:0.0:1789518226.423793:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789518226.423799:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522710912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518226.423827:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522710912:12345-0@lo:400:kworker.0 Request processed in 29us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518226.423834:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789518226.423887:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522710400:0@lo:400:kworker.0 00000100:00100000:0.0:1789518226.423899:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522710912:0@lo:400:kworker.0 00000100:00100000:0.0:1789518226.423908:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522710784:0@lo:400:kworker.0 00010000:00080000:0.0:1789518226.423918:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7302835c00 x1876445522711296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518226.423927:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522711296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424028:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522710528:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424057:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518226.424082:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522711040:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424104:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518226.424120:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522711552:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518226.424147:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789518226.424153:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522710656:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424178:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518226.424194:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7302836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522711168:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424211:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518226.424220:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522711680:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518226.424258:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522710656 00000100:00100000:1.0:1789518226.424262:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522710656 00000100:00100000:1.0:1789518226.424285:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789518226.424289:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522710656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424425:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522710656:12345-0@lo:400:kworker.0 Request processed in 135us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.424430:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789518226.424448:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.424456:0:6514:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789518226.424580:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522710656:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424600:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711808 00000100:00100000:1.0:1789518226.424603:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711808 00000100:00100000:1.0:1789518226.424630:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711424 00000100:00100000:1.0:1789518226.424633:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711424 00000100:00100000:1.0:1789518226.424645:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711936 00000100:00100000:1.0:1789518226.424647:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711936 00000100:00100000:1.0:1789518226.424657:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711040 00000100:00100000:1.0:1789518226.424659:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711040 00000100:00100000:1.0:1789518226.424669:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789518226.424674:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522711808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424711:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522711808:12345-0@lo:400:kworker.0 Request processed in 36us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.424717:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789518226.424728:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789518226.424733:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522711424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424757:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522711424:12345-0@lo:400:kworker.0 Request processed in 24us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.424762:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789518226.424773:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789518226.424779:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522711936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424802:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522711936:12345-0@lo:400:kworker.0 Request processed in 24us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.424812:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789518226.424822:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789518226.424827:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522711040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424858:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522711040:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.424864:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789518226.424884:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522711040:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.424912:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522710528 00000100:00100000:1.0:1789518226.424915:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522710528 00000100:00100000:1.0:1789518226.424932:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.424937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711552 00000100:00100000:1.0:1789518226.424939:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711552 00000100:00100000:1.0:1789518226.424949:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.424952:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711168 00000100:00100000:1.0:1789518226.424954:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711168 00000100:00100000:1.0:1789518226.424963:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.424966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522711680 00000100:00100000:1.0:1789518226.424968:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522711680 00000100:00100000:1.0:1789518226.424978:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.424983:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789518226.424988:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522710528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.425018:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522710528:12345-0@lo:400:kworker.0 Request processed in 31us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.425024:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789518226.425033:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.425038:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789518226.425043:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522711552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.425069:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522711552:12345-0@lo:400:kworker.0 Request processed in 26us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.425080:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789518226.425090:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.425095:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789518226.425100:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522711168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.425121:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522711168:12345-0@lo:400:kworker.0 Request processed in 22us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.425127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789518226.425135:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518226.425141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789518226.425146:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522711680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.425169:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522711680:12345-0@lo:400:kworker.0 Request processed in 23us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518226.425174:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789518226.425194:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7302836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522711168:0@lo:400:kworker.0 00010000:00080000:1.0:1789518226.425205:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f97ce00 x1876445522711680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518226.425215:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522711680:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.425226:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522710528:0@lo:400:kworker.0 00000100:00100000:1.0:1789518226.425233:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522711552:0@lo:400:kworker.0 00000100:00100000:0.0:1789518226.425448:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522711424:0@lo:400:kworker.0 00000100:00100000:0.0:1789518226.425459:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522711936:0@lo:400:kworker.0 00000100:00100000:0.0:1789518226.425487:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522711808:0@lo:400:kworker.0 00000100:00100000:2.0:1789518226.425752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789518226.425867:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518226.425876:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522712064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518226.425912:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518226.425956:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518226.425961:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518226.425970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518226.425972:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518226.426031:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522712064 00000100:00100000:2.0:1789518226.426035:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522712064 00000100:00100000:2.0:1789518226.426072:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789518226.426080:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e730373aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522712064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518226.426099:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789518226.426133:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e730373aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522712064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518226.426140:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789518226.426976:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522712064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518226.430989:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000001:00080000:0.0:1789518226.437395:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1789518226.437413:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1789518226.439854:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501681920 00000100:00100000:3.0:1789518226.439869:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501681920 00010000:00010000:2.0:1789518226.439980:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 39 pid: 8781 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518226.440015:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:2.0:1789518226.440025:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+39:2387:x1876445501681920:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518226.440040:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518226.440047:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 39 pid: 8781 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.440060:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 39 pid: 8781 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.440101:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad000/0x8d0fd67942314fb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856639f expref: 39 pid: 8781 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.440117:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:2.0:1789518226.440122:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.440132:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.440139:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518226.440180:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518226.440243:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+38:2387:x1876445501681920:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 219us (9262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518226.440250:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 92 00010000:00010000:3.0:1789518226.440491:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440499:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440538:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440546:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440564:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440570:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165c400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.440574:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440582:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440591:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.440593:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518226.440597:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.440603:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd67942315019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518226.440655:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+37:12374:x1876445501681536:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 23573us (23747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518226.440662:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:1.0:1789518226.445667:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.445749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501682176 00000100:00100000:0.0:1789518226.445758:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501682176 00000100:00100000:0.0:1789518226.445815:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:0.0:1789518226.445825:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+37:12374:x1876445501682176:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518226.446040:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+38:12374:x1876445501682176:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 215us (380us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789518226.446048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00010000:00010000:0.0:1789518226.486644:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518226.631049:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518226.631213:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501682432 00000100:00100000:1.0:1789518226.631234:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501682432 00000100:00100000:1.0:1789518226.631310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00100000:1.0:1789518226.631326:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+38:12385:x1876445501682432:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:1.0:1789518226.631351:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518226.631371:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942315020 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663c2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631443:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631457:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631505:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631521:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631528:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631535:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631650:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942315035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631660:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942315035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631668:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942315035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518226.631686:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789518226.631757:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631764:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631771:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631778:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0cc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518226.631782:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.631790:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632075:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:1.0:1789518226.632080:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518226.632085:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632092:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0cc00/0x8d0fd67942315027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632107:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632114:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632130:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632135:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518226.632138:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632145:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632153:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7441627e00) 00010000:00010000:1.0:1789518226.632156:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518226.632159:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632164:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd6794231502e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632207:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942315020 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c2 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632233:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942315035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c2 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518226.632241:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:1.0:1789518226.632244:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518226.632246:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d800, rc 0) 00000100:00100000:1.0:1789518226.632344:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+40:12385:x1876445501682432:12345-192.168.202.43@tcp:101:cat.0 Request processed in 1019us (1304us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789518226.632361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00100000:1.0:1789518226.637139:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.638518:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501682688 00000100:00100000:0.0:1789518226.638533:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501682688 00000100:00100000:0.0:1789518226.638606:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:0.0:1789518226.638617:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+40:12385:x1876445501682688:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:0.0:1789518226.638906:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+41:12385:x1876445501682688:12345-192.168.202.43@tcp:35:cat.0 Request processed in 290us (1776us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789518226.638914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:2.0:1789518226.677408:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.677509:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501682944 00000100:00100000:0.0:1789518226.677521:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501682944 00000100:00100000:0.0:1789518226.677589:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 213 00000100:00100000:0.0:1789518226.677599:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+41:12386:x1876445501682944:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:0.0:1789518226.677655:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789518226.677680:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942314fd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663ad expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677704:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d800/0x8d0fd67942315035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c2 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677719:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd6794231500b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663bb expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677731:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942314fc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663a6 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677740:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:0.0:1789518226.677745:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518226.677779:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677793:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677813:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677827:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677834:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677841:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677911:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677920:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.677927:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518226.678119:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789518226.678129:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394463664606ns, next at 395463661719ns, rc = 0 00010000:00010000:0.0:1789518226.678181:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678190:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678206:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678215:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678221:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678227:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678258:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518226.678276:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678283:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678290:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678297:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7a00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518226.678301:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678308:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678317:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:0.0:1789518226.678320:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518226.678329:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678335:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd67942315051 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678352:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678359:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678365:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678371:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518226.678374:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678380:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678387:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518226.678390:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518226.678393:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678399:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315043 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518226.678408:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6ea2b54 reply state 000000009215d329 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678429:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.678436:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359400) 00010000:00010000:0.0:1789518226.678438:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518226.678440:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518226.678556:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+39:12386:x1876445501682944:12345-192.168.202.43@tcp:36:rm.0 Request processed in 947us (1145us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789518226.678564:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 213 00010000:00010000:3.0:1789518226.678966:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518226.678973:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.678980:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518226.678984:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.678991:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.679001:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518226.679004:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518226.679008:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.679014:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315058 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.679025:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518226.679027:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518226.679029:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518226.795262:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.795353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501683200 00000100:00100000:3.0:1789518226.795363:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501683200 00000100:00100000:3.0:1789518226.795418:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 214 00000100:00100000:3.0:1789518226.795428:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+39:12392:x1876445501683200:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518226.795508:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518226.795530:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd6794231505f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.795647:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.795662:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.795673:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.795684:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.795691:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.795699:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518226.795994:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789518226.796116:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796126:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796172:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796179:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796187:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796193:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518226.796197:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796205:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796217:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518226.796219:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518226.796223:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796229:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315066 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518226.796243:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba7f5a31 reply state 00000000653ef0d3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796254:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796261:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359400) 00010000:00010000:3.0:1789518226.796269:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518226.796272:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518226.796312:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd6794231505f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796329:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.796337:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7435d04500) 00010000:00010000:3.0:1789518226.796339:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518226.796341:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740165ce00, rc 0) 00000100:00100000:3.0:1789518226.796399:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+42:12392:x1876445501683200:12345-192.168.202.43@tcp:101:bash.0 Request processed in 972us (1146us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789518226.796407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 214 00000100:00100000:1.0:1789518226.800599:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.800702:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501683328 00000100:00100000:0.0:1789518226.800712:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501683328 00000100:00100000:0.0:1789518226.800761:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:0.0:1789518226.800771:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501683328:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518226.800791:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518226.800819:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663d0 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518226.800846:0:13804:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518226.800866:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1789518226.800872:0:13804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518226.800881:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 6 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.800899:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 6 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.800931:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7200, rc 0) 00000100:00100000:0.0:1789518226.800989:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501683328:12345-192.168.202.43@tcp:101:bash.0 Request processed in 219us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518226.800998:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:2.0:1789518226.809943:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518226.810432:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501683456 00000100:00100000:3.0:1789518226.810441:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501683456 00000100:00100000:3.0:1789518226.810517:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:3.0:1789518226.810529:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+6:12392:x1876445501683456:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789518226.810557:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518226.810576:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663d7 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.810606:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.810617:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518226.810622:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518226.810628:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.810674:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 7 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.810688:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 7 pid: 13804 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518226.810704:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1876445522712192:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518226.810815:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518226.815287:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.815421:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501683584 00000100:00100000:0.0:1789518226.815431:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501683584 00010000:00010000:0.0:1789518226.815483:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 8 pid: 13804 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518226.815527:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 93 00000100:00100000:0.0:1789518226.815538:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501683584:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518226.815563:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518226.815584:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 8 pid: 13804 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.815598:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 8 pid: 13804 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.815621:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518226.815626:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518226.815635:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.815646:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518226.815692:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518226.815707:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1876445522712320:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789518226.815791:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a540 going to sleep for 11 seconds 00010000:00010000:3.0:1789518226.816679:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0bbf4c2/0x8d0fd67942315082 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d0 expref: 8 pid: 13804 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518226.816699:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1876445522712192:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518226.816723:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518226.816746:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740165c200, rc 0) 00000100:00100000:3.0:1789518226.816789:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:12392:x1876445501683456:12345-192.168.202.43@tcp:101:bash.0 Request processed in 6263us (6854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518226.816797:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:3.0:1789518226.820460:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1876445522712320:192.168.202.43@tcp:105: 00010000:00010000:3.0:1789518226.820509:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518226.820566:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501683584:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 5029us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518226.820586:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 93 00000100:00100000:1.0:1789518226.828088:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518226.828182:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501683840 00000100:00100000:0.0:1789518226.828192:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501683840 00000100:00100000:0.0:1789518226.828254:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:0.0:1789518226.828264:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+42:12392:x1876445501683840:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:0.0:1789518226.828807:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+43:12392:x1876445501683840:12345-192.168.202.43@tcp:35:bash.0 Request processed in 536us (718us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789518226.828815:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:1.0:1789518226.933941:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518226.933964:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522712448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518226.934030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518226.936503:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522712448 00000100:00100000:2.0:1789518226.936516:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522712448 00000100:00100000:2.0:1789518226.936596:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789518226.936606:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522712448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518226.936633:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789518226.936713:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522712448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518226.936741:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789518226.936951:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522712448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518227.094342:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.094516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501683968 00000100:00100000:2.0:1789518227.094528:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501683968 00000100:00100000:2.0:1789518227.094608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00100000:2.0:1789518227.094620:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+43:12408:x1876445501683968:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518227.094644:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518227.094664:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942315090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663de expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.094741:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.094756:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.094767:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518227.094810:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789518227.094814:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518227.094834:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.094858:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942315090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663de expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.094874:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663de expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.094903:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:2.0:1789518227.094906:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518227.094910:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ace00, rc 0) 00000100:00100000:2.0:1789518227.094967:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+44:12408:x1876445501683968:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 350us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518227.094975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00080000:3.0:1789518227.095604:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518227.106884:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.106997:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501684224 00000100:00100000:2.0:1789518227.107017:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501684224 00000100:00100000:2.0:1789518227.107084:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 216 00000100:00100000:2.0:1789518227.107094:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+44:12408:x1876445501684224:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518227.107113:0:14668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518227.107134:0:14668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231509e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663e5 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.107235:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423150a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.107249:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423150a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.107259:0:14668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423150a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518227.107270:0:14668:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789518227.107394:0:14668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231509e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663e5 expref: 47 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.107432:0:14668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423150a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663e5 expref: 46 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.107440:0:14668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7435d04500) 00010000:00010000:2.0:1789518227.107443:0:14668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518227.107446:0:14668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad600, rc 0) 00000100:00100000:2.0:1789518227.107614:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f83ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+46:12408:x1876445501684224:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 520us (738us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789518227.107621:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 216 00000100:00100000:1.0:1789518227.114931:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518227.114981:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.115058:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501684608 00000100:00100000:2.0:1789518227.115068:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501684608 00000100:00100000:2.0:1789518227.115133:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:2.0:1789518227.115143:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740973e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+46:2390:x1876445501684608:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518227.115157:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518227.115180:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd679423150a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663e5 expref: 46 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.115200:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7435d04500) 00010000:00010000:2.0:1789518227.115206:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518227.115257:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740973e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+45:2390:x1876445501684608:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518227.115265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:0.0:1789518227.115986:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501684480 00000100:00100000:0.0:1789518227.115994:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501684480 00000100:00100000:0.0:1789518227.116043:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 217 00000100:00100000:0.0:1789518227.116050:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+45:12408:x1876445501684480:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518227.116070:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518227.116087:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423150b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663ec expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.116193:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.116218:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.116230:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518227.116242:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789518227.118147:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423150b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663ec expref: 48 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.118173:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663ec expref: 47 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.118183:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7435d04500) 00010000:00010000:0.0:1789518227.118186:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789518227.118189:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7c00, rc 0) 00000100:00100000:0.0:1789518227.118257:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+47:12408:x1876445501684480:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 2206us (3333us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789518227.118265:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 217 00000100:00100000:1.0:1789518227.133689:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.133873:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501684736 00000100:00100000:3.0:1789518227.133887:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501684736 00000100:00100000:3.0:1789518227.133979:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:3.0:1789518227.133991:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501684736:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:3.0:1789518227.134048:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.134071:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.134081:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518227.134087:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518227.134092:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.134134:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.134160:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 6 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518227.134176:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876445522712576:192.168.202.43@tcp:104: 00000100:00080000:0.0:1789518227.134297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518227.134734:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518227.139755:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1876445522712576:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518227.140360:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518227.141049:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.141281:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501684864 00000100:00100000:0.0:1789518227.141293:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501684864 00002000:00100000:0.0:1789518227.141399:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e7303f55880 x1876445501684864/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:628/0 lens 504/0 e 0 to 0 dl 1789518238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518227.141412:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303f55880 with x1876445501684864 ext(0->8) 00010000:00010000:0.0:1789518227.141421:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 7 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.141454:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 7 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518227.141483:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7303f55880 00000100:00100000:0.0:1789518227.141574:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:0.0:1789518227.141586:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501684864:12345-192.168.202.43@tcp:4:lfs.0 00000100:00100000:0.0:1789518227.143373:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501684864:12345-192.168.202.43@tcp:4:lfs.0 Request processed in 1779us (2318us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789518227.143386:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00002000:00100000:0.0:1789518227.143398:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e7303f55880 x1876445501684864/t4294967309(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:628/0 lens 504/448 e 0 to 0 dl 1789518238 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518227.143410:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303f55880 with x1876445501684864 ext(0->8) 00010000:00010000:0.0:1789518227.143420:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.143437:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518227.143446:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e7303f55880 00000100:00100000:1.0:1789518227.146781:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.146868:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501684992 00000100:00100000:2.0:1789518227.146881:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501684992 00010000:00010000:2.0:1789518227.146927:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518227.146988:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:2.0:1789518227.146998:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+9:2389:x1876445501684992:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518227.147016:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518227.147037:0:9516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789518227.147040:0:9516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789518226 00002000:00010000:2.0:1789518227.147043:0:9516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789518227 00002000:00010000:2.0:1789518227.147045:0:9516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789518226 00002000:00010000:2.0:1789518227.147048:0:9516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789518227.147054:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.147069:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.147099:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000185ef554/0x8d0fd67942315089 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663d7 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.147121:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518227.147125:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518227.147132:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.147201:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.147342:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518227.147534:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+8:2389:x1876445501684992:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 536us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518227.147552:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 94 00010000:00010000:0.0:1789518227.147737:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147748:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147784:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147793:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147801:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147809:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165c400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518227.147813:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147823:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147835:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.147842:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003331c985/0x8d0fd679423150c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518227.147892:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501684736:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 13905us (14218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.147901:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:1.0:1789518227.151100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.151411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501685248 00000100:00100000:3.0:1789518227.151423:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501685248 00000100:00100000:3.0:1789518227.151711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:3.0:1789518227.151723:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+47:12408:x1876445501685248:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:3.0:1789518227.151806:0:6517:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663ec expref: 47 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518227.152018:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789518227.152047:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789518227.152855:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1789518227.152902:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.152919:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.152929:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.152971:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.152987:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 51 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518227.153003:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1876445522712704:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518227.153117:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518227.157051:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.157122:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501685376 00000100:00100000:2.0:1789518227.157134:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501685376 00010000:00010000:2.0:1789518227.157329:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 52 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518227.157429:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:2.0:1789518227.157441:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+52:2388:x1876445501685376:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518227.157460:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518227.157489:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 52 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.157504:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 52 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.157531:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7435d04500) 00010000:00010000:2.0:1789518227.157537:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.157558:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.157567:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.157764:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518227.157822:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+52:2388:x1876445501685376:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 383us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518227.157830:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 95 00010000:00010000:3.0:1789518227.159125:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd67942315074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663c9 expref: 51 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518227.159282:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1876445522712704:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518227.159310:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.159459:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.160704:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518227.160870:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789518227.161037:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789518227.164665:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303416300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522712832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518227.164757:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518227.164802:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518227.164822:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522712832 00000100:00100000:1.0:1789518227.164834:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522712832 00000100:00100000:1.0:1789518227.164905:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789518227.164917:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1876445522712832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518227.165026:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1876445522712832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.165035:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789518227.165628:0:6517:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1789518227.165635:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1789518227.165659:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7303db6680, transno 4294967308 00000100:00100000:2.0:1789518227.165679:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303416300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522712832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518227.165823:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789518227.165970:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303416300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522712960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518227.166011:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518227.166031:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518227.166046:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522712960 00000100:00100000:3.0:1789518227.166052:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522712960 00000100:00100000:3.0:1789518227.166086:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789518227.166100:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1876445522712960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518227.166409:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1876445522712960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 309us (407us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789518227.166418:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789518227.166443:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303416300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1876445522712960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518227.166517:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789518227.166565:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.166594:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.166603:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.166610:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518227.166615:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.166624:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.166643:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7435d04500) 00010000:00010000:2.0:1789518227.166646:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789518227.166651:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.166658:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518227.166757:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789518227.166816:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789518227.166828:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394952363843ns, next at 395952361003ns, rc = 0 00000001:00080000:2.0:1789518227.166834:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789518227.166853:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7435d04500) 00010000:00010000:2.0:1789518227.166856:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518227.167052:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663ec expref: 55 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518227.167180:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+54:12408:x1876445501685248:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 15459us (16091us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789518227.167189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000020:00080000:2.0:1789518227.167193:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518227.169331:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.169436:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501685504 00000100:00100000:0.0:1789518227.169446:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501685504 00000100:00100000:0.0:1789518227.169536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 218 00000100:00100000:0.0:1789518227.169562:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+54:12408:x1876445501685504:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518227.169695:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518227.169723:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423150d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.169795:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423150d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663f3 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.169812:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423150d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663f3 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.169832:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518227.169835:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518227.169839:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7a00, rc 0) 00000100:00100000:0.0:1789518227.169931:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+55:12408:x1876445501685504:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 373us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.169938:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 218 00000100:00100000:1.0:1789518227.174891:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.174967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501685760 00000100:00100000:0.0:1789518227.174980:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501685760 00000100:00100000:0.0:1789518227.175050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:0.0:1789518227.175061:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+55:12408:x1876445501685760:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518227.175639:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+56:12408:x1876445501685760:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 578us (822us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789518227.175647:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:1.0:1789518227.262233:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.269414:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501685888 00000100:00100000:3.0:1789518227.269435:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501685888 00000100:00100000:3.0:1789518227.269558:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 219 00000100:00100000:3.0:1789518227.269570:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+56:12418:x1876445501685888:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:3.0:1789518227.269670:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.269692:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.269722:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.269757:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.269765:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.269781:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270013:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270023:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270031:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518227.270093:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270108:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270115:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270123:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270129:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165ce00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518227.270134:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270148:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270163:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518227.270166:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518227.270172:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270178:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd679423150dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270196:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270203:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270209:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270213:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518227.270216:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270223:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270229:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359400) 00010000:00010000:3.0:1789518227.270232:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518227.270234:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270248:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd679423150e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270260:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270266:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270272:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270277:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518227.270280:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270286:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270293:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518227.270294:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518227.270297:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.270303:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd679423150eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518227.270394:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+56:12418:x1876445501685888:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 825us (8174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518227.270402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 219 00000100:00100000:1.0:1789518227.329358:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.329506:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501686144 00000100:00100000:0.0:1789518227.329519:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501686144 00000100:00100000:0.0:1789518227.329629:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 220 00000100:00100000:0.0:1789518227.329641:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+56:12421:x1876445501686144:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518227.329669:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518227.329704:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423150f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785663fa expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.329800:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.329817:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.329830:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.329841:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.329848:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.329854:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330001:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315107 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330018:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330047:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518227.330058:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789518227.330163:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330171:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330179:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330185:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518227.330190:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330198:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330210:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518227.330213:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518227.330219:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330225:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd679423150f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330240:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330245:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330257:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330262:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518227.330265:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330271:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330279:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359400) 00010000:00010000:0.0:1789518227.330281:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518227.330284:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330290:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330326:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd679423150f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663fa expref: 59 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330340:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663fa expref: 58 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.330348:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518227.330350:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518227.330353:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6800, rc 0) 00000100:00100000:0.0:1789518227.330425:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+58:12421:x1876445501686144:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 786us (1079us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789518227.330440:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 220 00000100:00100000:0.0:1789518227.334287:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.335258:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501686272 00000100:00100000:2.0:1789518227.335274:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501686272 00000100:00100000:3.0:1789518227.335665:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 221 00000100:00100000:3.0:1789518227.335839:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+58:12421:x1876445501686272:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:3.0:1789518227.335933:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.335963:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.335978:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.336028:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.336035:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.336042:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.336048:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518227.336053:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.336060:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.336073:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518227.336077:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518227.336082:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.336107:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd67942315115 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518227.336499:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+58:12421:x1876445501686272:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 822us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518227.336508:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 221 00000100:00100000:1.0:1789518227.343198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.343353:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501686528 00000100:00100000:2.0:1789518227.343365:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501686528 00000100:00100000:2.0:1789518227.343507:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:2.0:1789518227.343520:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+58:12421:x1876445501686528:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518227.344018:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+59:12421:x1876445501686528:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 499us (886us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789518227.344027:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:1.0:1789518227.447403:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518227.447436:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522713088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518227.447560:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518227.449392:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522713088 00000100:00100000:2.0:1789518227.449408:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522713088 00000100:00100000:2.0:1789518227.449496:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789518227.449509:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522713088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518227.449553:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518227.450372:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518227.450393:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522713344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518227.450482:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518227.450495:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522713216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518227.463996:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518227.466326:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518227.467327:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522713344 00000100:00100000:1.0:1789518227.467342:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522713344 00000100:00100000:1.0:1789518227.467417:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522713216 00000100:00100000:1.0:1789518227.467421:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522713216 00000100:00100000:1.0:1789518227.467443:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789518227.467454:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522713344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518227.467529:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518227.467622:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522713344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (3638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.467630:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789518227.467650:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789518227.467657:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522713216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518227.467676:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789518227.468234:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522713216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 575us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.468243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789518227.469182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522713344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518227.469818:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522713216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518227.490556:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522713088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41021us (42968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518227.490576:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789518227.490889:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522713088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518227.492954:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.494123:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501686784 00000100:00100000:2.0:1789518227.494683:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501686784 00000100:00100000:2.0:1789518227.494884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00100000:2.0:1789518227.494897:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+59:12431:x1876445501686784:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518227.494952:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518227.494957:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518227.494996:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663de expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.496079:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:2.0:1789518227.496088:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518227.496113:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231511c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.496383:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942315123 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.496402:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942315123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.496416:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942315123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518227.496429:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789518227.497958:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231511c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566401 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.497987:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942315123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566401 expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.497997:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:2.0:1789518227.498000:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518227.498004:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033adc00, rc 0) 00000100:00100000:2.0:1789518227.498899:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+60:12431:x1876445501686784:12345-192.168.202.43@tcp:101:bash.0 Request processed in 4002us (5951us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789518227.498909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00100000:1.0:1789518227.503922:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.504026:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501686912 00000100:00100000:2.0:1789518227.504039:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501686912 00000100:00100000:2.0:1789518227.504116:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 223 00000100:00100000:2.0:1789518227.504129:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+60:12431:x1876445501686912:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518227.504170:0:14668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518227.504199:0:14668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942315131 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566408 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.504256:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.504275:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.504291:0:14668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.504451:0:14668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942315131 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 62 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.504503:0:14668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 61 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.504514:0:14668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:2.0:1789518227.504517:0:14668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518227.504523:0:14668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ace00, rc 0) 00000100:00100000:3.0:1789518227.523979:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+61:12431:x1876445501686912:12345-192.168.202.43@tcp:101:bash.0 Request processed in 19830us (20047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518227.523996:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 223 00000100:00100000:2.0:1789518227.526439:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.526926:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501687040 00000100:00100000:0.0:1789518227.526939:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501687040 00000100:00100000:0.0:1789518227.527024:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789518227.527036:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+61:2388:x1876445501687040:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518227.527055:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518227.527087:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd67942315123 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566401 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.527111:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518227.527118:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518227.527184:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+60:2388:x1876445501687040:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 150us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.527193:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:2.0:1789518227.529844:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.534679:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501687296 00000100:00100000:3.0:1789518227.534700:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501687296 00000100:00100000:3.0:1789518227.534786:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 224 00000100:00100000:3.0:1789518227.534799:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+60:12431:x1876445501687296:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:3.0:1789518227.534874:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518227.534908:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd67942315107 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663fa expref: 60 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.534937:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518227.534944:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518227.535183:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.535225:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.535238:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518227.535291:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1789518227.535319:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a863970 reply state 00000000f8487057 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.535332:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.535338:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518227.535341:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518227.535344:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518227.535488:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+62:12431:x1876445501687296:12345-192.168.202.43@tcp:36:bash.0 Request processed in 692us (5653us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789518227.535497:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 224 00000020:00080000:3.0:1789518227.535502:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518227.537835:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518227.552343:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.552519:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501687424 00000100:00100000:2.0:1789518227.552533:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501687424 00000100:00100000:2.0:1789518227.552625:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 225 00000100:00100000:2.0:1789518227.552637:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740565cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+62:12431:x1876445501687424:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789518227.552671:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518227.552713:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942315146 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856640f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.552838:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.552858:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.552873:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518227.552910:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789518227.552915:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518227.552938:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.552972:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd67942315146 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.552993:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.553038:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:2.0:1789518227.553042:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518227.553048:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033adc00, rc 0) 00000100:00100000:2.0:1789518227.553120:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740565cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+63:12431:x1876445501687424:12345-192.168.202.43@tcp:101:bash.0 Request processed in 485us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518227.553129:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 225 00000100:00100000:3.0:1789518227.557496:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.557625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501687680 00000100:00100000:0.0:1789518227.557637:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501687680 00000100:00100000:0.0:1789518227.557732:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:0.0:1789518227.557746:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+63:12431:x1876445501687680:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:0.0:1789518227.558511:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+64:12431:x1876445501687680:12345-192.168.202.43@tcp:35:bash.0 Request processed in 767us (1061us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789518227.558549:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:1.0:1789518227.702441:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.704078:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501687808 00000100:00100000:3.0:1789518227.704098:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501687808 00000100:00100000:3.0:1789518227.704198:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 226 00000100:00100000:3.0:1789518227.704212:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+64:12437:x1876445501687808:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518227.704570:0:14668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518227.704601:0:14668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566416 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.705024:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd6794231515b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.705042:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd6794231515b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.705056:0:14668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd6794231515b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518227.705113:0:14668:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789518227.705118:0:14668:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518227.705787:0:14668:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd6794231515b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.705825:0:14668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566416 expref: 66 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.705852:0:14668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd6794231515b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566416 expref: 65 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.705862:0:14668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518227.705866:0:14668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518227.705870:0:14668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740165ce00, rc 0) 00000100:00100000:3.0:1789518227.705971:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+65:12437:x1876445501687808:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1762us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518227.705981:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 226 00000100:00100000:1.0:1789518227.718025:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.718158:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501687936 00000100:00100000:0.0:1789518227.718168:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501687936 00000100:00100000:0.0:1789518227.718237:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 227 00000100:00100000:0.0:1789518227.718248:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+65:12437:x1876445501687936:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518227.718268:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518227.718291:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942315162 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856641d expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718360:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718393:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718404:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718417:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718425:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718431:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718564:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942315177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718590:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942315177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718599:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942315177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518227.718880:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789518227.718885:0:8781:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518227.718904:0:8781:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942315177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718916:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942315177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718924:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718930:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718936:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718942:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518227.718946:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718953:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718965:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518227.718968:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518227.718979:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.718985:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315169 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719000:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719005:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719010:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719014:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518227.719017:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719022:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719028:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359400) 00010000:00010000:0.0:1789518227.719030:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518227.719033:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719038:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd67942315170 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719062:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942315162 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856641d expref: 67 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719087:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942315177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856641d expref: 66 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.719094:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518227.719097:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518227.719099:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6e00, rc 0) 00000100:00100000:0.0:1789518227.719155:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+66:12437:x1876445501687936:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 910us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.719163:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 227 00000100:00100000:0.0:1789518227.721956:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.725417:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501688064 00000100:00100000:3.0:1789518227.725434:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501688064 00000100:00100000:3.0:1789518227.725571:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789518227.725582:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+66:2388:x1876445501688064:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518227.725598:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518227.725869:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6e00/0x8d0fd67942315177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856641d expref: 66 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.725891:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518227.725897:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518227.725957:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+65:2388:x1876445501688064:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 377us (4009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518227.725965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:1.0:1789518227.727025:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518227.727105:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501688320 00000100:00100000:2.0:1789518227.727121:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501688320 00000100:00100000:2.0:1789518227.727203:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 228 00000100:00100000:2.0:1789518227.727215:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+65:12437:x1876445501688320:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789518227.727241:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518227.727265:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231517e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566424 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.729205:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.729235:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.729246:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.729298:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.729314:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 66 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518227.729350:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303416a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522713472:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518227.729515:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740dd53780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518227.735000:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.735171:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501688448 00000100:00100000:0.0:1789518227.735182:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501688448 00010000:00010000:0.0:1789518227.735222:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 67 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518227.735362:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303416a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1876445522713472:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518227.735405:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518227.735685:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 96 00000100:00100000:0.0:1789518227.735697:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+67:2387:x1876445501688448:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518227.735714:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518227.735722:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 67 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.735735:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 67 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.735758:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033adc00/0x8d0fd6794231514d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856640f expref: 67 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.735794:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518227.735799:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.735809:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.735816:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.735847:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518227.735894:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+66:2387:x1876445501688448:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 200us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.735902:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 96 00010000:00010000:2.0:1789518227.736314:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.736335:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518227.736357:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789518227.736546:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad600/0x8d0fd6794231517e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.736562:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518227.736570:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:2.0:1789518227.736573:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518227.736576:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033aca00, rc 0) 00000100:00100000:2.0:1789518227.736636:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+66:12437:x1876445501688320:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 9410us (9599us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789518227.736644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 228 00000100:00100000:1.0:1789518227.745131:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.745261:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501688704 00000100:00100000:3.0:1789518227.745271:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501688704 00000100:00100000:3.0:1789518227.745380:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:3.0:1789518227.745398:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+66:12437:x1876445501688704:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:3.0:1789518227.745416:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518227.745443:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423150d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663f3 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.745461:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518227.745497:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518227.745561:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+65:12437:x1876445501688704:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 165us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518227.745569:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789518227.749579:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518227.751341:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501688832 00000100:00100000:3.0:1789518227.751355:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501688832 00000100:00100000:3.0:1789518227.751437:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 229 00000100:00100000:3.0:1789518227.751477:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+65:12437:x1876445501688832:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:3.0:1789518227.751621:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.751654:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518227.751668:0:14668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518227.751768:0:14668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789518227.751859:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+65:12437:x1876445501688832:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 400us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518227.751866:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 229 00000100:00100000:1.0:1789518227.760755:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518227.761140:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501688960 00000100:00100000:0.0:1789518227.761150:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501688960 00000100:00100000:0.0:1789518227.761211:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 230 00000100:00100000:0.0:1789518227.761222:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+65:12437:x1876445501688960:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518227.761241:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518227.761262:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856642b expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.761317:0:8781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.761329:0:8781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 66 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.761366:0:8781:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.761380:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 66 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.761394:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518227.761397:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518227.761401:0:8781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 66 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.761409:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7600, rc 0) 00000100:00100000:0.0:1789518227.761460:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+66:12437:x1876445501688960:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 240us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.761495:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 230 00010000:00010000:0.0:1789518228.538811:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518228.725992:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518228.726005:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518228.726036:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789518228.726050:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518228.726216:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522713600:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518228.726364:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518228.736167:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518228.736298:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501689088 00000100:00100000:2.0:1789518228.736336:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501689088 00000100:00100000:2.0:1789518228.736418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:2.0:1789518228.736431:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+67:12439:x1876445501689088:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518228.736501:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518228.736658:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+67:12439:x1876445501689088:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 228us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.736667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:1.0:1789518228.746689:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518228.747033:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501689216 00000100:00100000:3.0:1789518228.747047:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501689216 00000100:00100000:0.0:1789518228.747050:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522713600:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518228.747141:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 232 00000100:00100000:3.0:1789518228.747154:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+66:12439:x1876445501689216:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518228.747613:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747634:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747650:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747668:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747698:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747705:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747734:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747752:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747759:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518228.747912:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789518228.747918:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518228.747937:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747951:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747958:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747966:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747973:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165c400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.747978:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.747995:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748011:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:3.0:1789518228.748014:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.748020:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748027:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c400/0x8d0fd679423151a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748044:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748051:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748057:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748062:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165c200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.748066:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748072:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748090:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8e7435d04100) 00010000:00010000:3.0:1789518228.748093:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.748097:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.748115:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165c200/0x8d0fd679423151a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.753495:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.753518:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.753536:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.753544:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.753551:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.753561:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.753583:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518228.753587:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.753594:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.753601:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd679423151af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518228.753736:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+66:12439:x1876445501689216:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 6578us (7055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518228.753750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 232 00000001:00080000:2.0:1789518228.761934:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:2.0:1789518228.761973:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789518228.762009:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e740dd53540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789518228.762016:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e743b594c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e740dd53a80 00000020:00080000:2.0:1789518228.762019:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e743b594000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e73030d3000 00000004:00080000:2.0:1789518228.762050:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789518228.762088:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e74012ed180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789518228.762091:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7435e6ea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e74012edb40 00000020:00080000:2.0:1789518228.762094:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7435e6ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e7435e3ea00 00000020:00080000:2.0:1789518228.762112:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:3.0:1789518228.762183:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762209:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762218:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762224:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.762230:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762239:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762260:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8e7441628900) 00010000:00010000:3.0:1789518228.762263:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.762270:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762276:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942314f24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762315:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762323:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762329:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762358:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165de00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.762362:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762368:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762378:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518228.762380:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.762383:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762389:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165de00/0x8d0fd67942314fcc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762424:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762433:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762439:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762457:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.762461:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762499:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762520:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359400) 00010000:00010000:3.0:1789518228.762522:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.762536:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762544:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd6794231504a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762557:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762563:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762568:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762573:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165da00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.762576:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762582:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762590:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359400) 00010000:00010000:3.0:1789518228.762593:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.762596:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762601:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165da00/0x8d0fd6794231506d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762646:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762654:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762660:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762665:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.762668:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762675:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762683:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518228.762686:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.762689:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.762694:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d800/0x8d0fd6794231513f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789518228.762715:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789518228.762806:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789518228.762934:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518228.762957:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522713728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789518228.763044:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518228.763108:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522713728 00000100:00100000:3.0:1789518228.763123:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522713728 00000100:00100000:3.0:1789518228.763191:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518228.763204:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522713728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518228.763237:0:9982:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1789518228.763264:0:9982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.763287:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 8 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.763298:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789518228.763303:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518228.763308:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.763339:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 8 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.763356:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 8 pid: 13804 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518228.763368:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522713856:192.168.202.43@tcp:104: 00000100:00080000:0.0:1789518228.763788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518228.763804:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518228.763814:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522713984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789518228.763856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518228.763895:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522713984 00000100:00100000:0.0:1789518228.763899:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522713984 00000100:00100000:0.0:1789518228.763933:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518228.763940:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522713984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789518228.763954:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1789518228.763984:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa9e192, atime: 0x6aa9e193, ctime: 0x6aa9e192, blocks: 0x8 00010000:00010000:0.0:1789518228.763991:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764013:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1789518228.764018:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518228.764024:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764042:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764053:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764061:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764080:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518228.764312:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1876445522713984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (382us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789518228.764330:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:0.0:1789518228.764362:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518228.764369:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764377:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518228.764381:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764389:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764401:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764408:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423151bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.764425:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.764427:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.764429:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518228.764435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789518228.764610:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7435e90700/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789518228.764791:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522713984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518228.767575:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518228.770695:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518228.771725:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501689472 00000100:00100000:3.0:1789518228.771738:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501689472 00000100:00100000:3.0:1789518228.771822:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:3.0:1789518228.771835:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+19:12439:x1876445501689472:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518228.771878:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518228.771906:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423151c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772051:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772072:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772088:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518228.772102:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789518228.772216:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772225:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772234:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772241:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c2e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.772246:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772255:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772271:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518228.772280:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518228.772287:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772295:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772348:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423151c4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566432 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772359:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:3.0:1789518228.772362:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518228.772366:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd679423151c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566432 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.772379:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031e00, rc 0) 00000100:00100000:3.0:1789518228.772459:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+20:12439:x1876445501689472:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 626us (1775us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1789518228.772500:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:2.0:1789518228.787833:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518228.787930:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501689600 00000100:00100000:3.0:1789518228.787945:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501689600 00000100:00100000:3.0:1789518228.788025:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 234 00000100:00100000:3.0:1789518228.788038:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+20:12439:x1876445501689600:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000100:00100000:2.0:1789518228.788066:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000004:00000080:3.0:1789518228.788086:0:14668:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518228.788110:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501689728 00000100:00100000:3.0:1789518228.788114:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501689728 00000100:00080000:3.0:1789518228.788139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789518228.788168:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 9 pid: 13804 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518228.788228:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:3.0:1789518228.788235:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7405e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501689728:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518228.788247:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518228.788256:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 9 pid: 13804 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518228.788257:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+20:12439:x1876445501689600:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 210us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.788266:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 234 00010000:00010000:3.0:1789518228.788271:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 9 pid: 13804 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.788299:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518228.788304:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518228.788313:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.788324:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.790087:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518228.790151:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7405e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501689728:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 1910us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.790186:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:1.0:1789518228.792408:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518228.792636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501689984 00000100:00100000:3.0:1789518228.792650:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501689984 00000100:00100000:3.0:1789518228.792721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 235 00000100:00100000:3.0:1789518228.792733:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+20:12439:x1876445501689984:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518228.792759:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518228.792764:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518228.792810:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165ce00/0x8d0fd6794231515b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566416 expref: 20 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.792853:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518228.792860:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518228.792877:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566439 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518228.793497:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789518228.793751:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2000/0x8d0fd679423151e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.793766:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2000/0x8d0fd679423151e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.793847:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2000/0x8d0fd679423151e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.793910:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423151d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566439 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.793927:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2000/0x8d0fd679423151e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566439 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.793935:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518228.793938:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518228.793941:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e74421c2000, rc 0) 00000100:00100000:3.0:1789518228.794556:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501689984:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1822us (2154us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789518228.794565:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 235 00010000:00010000:0.0:1789518228.796611:0:9982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c81fe541/0x8d0fd67942314fda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785663b4 expref: 8 pid: 13804 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518228.796664:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522713856:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518228.796695:0:9982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.796763:0:9982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.796772:0:9982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.796785:0:9982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.796793:0:9982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.796825:0:9982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518228.797628:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.797638:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.797648:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518228.797653:0:7454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.797664:0:7454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.797685:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.797692:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005caa88ef/0x8d0fd679423151b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.797717:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.797729:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.797731:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518228.797835:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.799209:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522713728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36002us (36159us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789518228.799223:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:2.0:1789518228.801246:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7303f4f800/2, rc 0, transno 4294967320 00000100:00100000:2.0:1789518228.801265:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522713728:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789518228.805393:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1789518228.805414:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000100:00100000:3.0:1789518228.806487:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501690240 00000100:00100000:3.0:1789518228.806503:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501690240 00000100:00100000:3.0:1789518228.806588:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 236 00000100:00100000:3.0:1789518228.806609:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501690240:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518228.806690:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518228.806726:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2000/0x8d0fd679423151e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566439 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806752:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e7435d04c00) 00010000:00010000:3.0:1789518228.806765:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518228.806806:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806824:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806837:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806865:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806873:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806881:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806942:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806971:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806979:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.806986:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c2400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.806992:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807000:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807009:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518228.807012:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.807018:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807024:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd679423151ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807035:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807041:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807046:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807052:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518228.807061:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807068:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807076:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x67b1f6e6 (ffff8e7435d04100) 00010000:00010000:3.0:1789518228.807079:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518228.807082:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.807087:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd679423151f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x67b1f6e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518228.807190:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+20:12439:x1876445501690240:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 583us (9355us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518228.807199:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 236 00000100:00100000:1.0:1789518228.811276:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518228.811366:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501690368 00000100:00100000:2.0:1789518228.811377:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501690368 00000100:00100000:2.0:1789518228.811451:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 237 00000100:00100000:2.0:1789518228.811497:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+20:12439:x1876445501690368:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518228.811540:0:14668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518228.811570:0:14668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd679423151fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566440 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.811617:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.811635:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.811648:0:14668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.811798:0:14668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ada00/0x8d0fd679423151fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 22 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.811820:0:14668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 21 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.811843:0:14668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:2.0:1789518228.811847:0:14668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518228.812208:0:14668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ade00, rc 0) 00000100:00100000:2.0:1789518228.812290:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501690368:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 829us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.812298:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 237 00000100:00100000:2.0:1789518228.820826:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518228.821584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501690624 00000100:00100000:3.0:1789518228.821599:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501690624 00000100:00100000:3.0:1789518228.821681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 238 00000100:00100000:3.0:1789518228.821692:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501690624:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518228.821812:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.821834:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.821859:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518228.822078:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1789518228.822110:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396607645377ns, next at 397607642294ns, rc = 0 00000004:00010000:3.0:1789518228.822171:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6ea2b54 reply state 00000000a56e6fab transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.822186:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.822195:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:3.0:1789518228.822198:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789518228.822204:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518228.822339:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+23:12439:x1876445501690624:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 648us (1527us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789518228.822347:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 238 00000100:00100000:1.0:1789518228.830286:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.830397:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501690752 00000100:00100000:0.0:1789518228.830411:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501690752 00000100:00100000:0.0:1789518228.830554:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 239 00000100:00100000:0.0:1789518228.830586:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+23:12439:x1876445501690752:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518228.830622:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518228.830648:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566447 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.830725:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 24 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.830743:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 24 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.830765:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:0.0:1789518228.830769:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518228.830774:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6a00, rc 0) 00000100:00100000:0.0:1789518228.830860:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+24:12439:x1876445501690752:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 270us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.830868:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 239 00000100:00100000:1.0:1789518228.835122:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.835236:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501690880 00000100:00100000:0.0:1789518228.835249:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501690880 00000100:00100000:0.0:1789518228.835422:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:0.0:1789518228.835434:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+6:2387:x1876445501690880:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789518228.836173:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501690880:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 739us (1062us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789518228.836184:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:2.0:1789518228.845545:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518228.845712:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501691136 00000100:00100000:1.0:1789518228.845726:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501691136 00000100:00100000:1.0:1789518228.845808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:1.0:1789518228.845820:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+24:12439:x1876445501691136:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518228.846566:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+25:12439:x1876445501691136:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 745us (1043us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789518228.846583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:3.0:1789518228.848751:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518228.848875:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501691392 00000100:00100000:2.0:1789518228.848886:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501691392 00000100:00100000:2.0:1789518228.848954:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 240 00000100:00100000:2.0:1789518228.848966:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+25:12439:x1876445501691392:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518228.849143:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+25:12439:x1876445501691392:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 179us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.849151:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 240 00000100:00100000:2.0:1789518228.881821:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.890345:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501691520 00000100:00100000:0.0:1789518228.890367:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501691520 00000100:00100000:0.0:1789518228.890481:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 241 00000100:00100000:0.0:1789518228.890494:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+25:12439:x1876445501691520:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518228.890521:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518228.890636:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315218 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856644e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.890734:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231521f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.890752:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231521f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.890765:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231521f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518228.890823:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518228.890849:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231521f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.890882:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315218 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856644e expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.890906:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231521f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856644e expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.890915:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:0.0:1789518228.890918:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789518228.890923:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7000, rc 0) 00000100:00100000:0.0:1789518228.891015:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+26:12439:x1876445501691520:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 524us (9207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.891022:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 241 00000100:00100000:1.0:1789518228.895308:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.898180:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501691648 00000100:00100000:0.0:1789518228.898201:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501691648 00000100:00100000:0.0:1789518228.898299:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:0.0:1789518228.898312:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501691648:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518228.898336:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518228.898363:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566455 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518228.898394:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e194, blocks: 0x0 00010000:00010000:0.0:1789518228.898420:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1789518228.898425:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518228.898436:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.898456:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.898503:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6c00, rc 0) 00000100:00100000:0.0:1789518228.898654:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501691648:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 344us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.898662:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:3.0:1789518228.908720:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518228.909755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501691904 00000100:00100000:1.0:1789518228.909773:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501691904 00000100:00100000:1.0:1789518228.909858:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 242 00000100:00100000:1.0:1789518228.909871:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+26:12439:x1876445501691904:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518228.910028:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+26:12439:x1876445501691904:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 159us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518228.910037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 242 00000100:00100000:3.0:1789518228.925839:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.925968:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501692032 00000100:00100000:0.0:1789518228.925981:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501692032 00000100:00100000:0.0:1789518228.926054:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:0.0:1789518228.926066:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+8:12439:x1876445501692032:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518228.926090:0:9982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518228.926115:0:9982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856645c expref: -99 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.926203:0:9982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.926214:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518228.926220:0:9982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518228.926227:0:9982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.926515:0:9982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.926543:0:9982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 9 pid: 8428 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518228.926561:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522714112:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518228.926682:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518228.928782:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9982:1876445522714112:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518228.928819:0:9982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 9 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.928843:0:9982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6000, rc 0) 00000100:00100000:0.0:1789518228.928913:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+9:12439:x1876445501692032:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 2848us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.928923:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:3.0:1789518228.929674:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.930162:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501692160 00000100:00100000:0.0:1789518228.930172:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501692160 00010000:00010000:0.0:1789518228.930224:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 9 pid: 8428 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518228.930316:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:0.0:1789518228.930327:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501692160:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518228.930354:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518228.930384:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 9 pid: 8428 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.930397:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 9 pid: 8428 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.930424:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315226 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566455 expref: 9 pid: 8428 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.930443:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518228.930448:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518228.930458:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.930560:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.930602:0:9516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518228.930632:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9516:1876445522714240:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789518228.930711:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518228.934304:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518228.934542:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501692288 00000100:00100000:1.0:1789518228.934554:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501692288 00002000:00100000:1.0:1789518228.934613:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8e7303f4d880 x1876445501692288/t0(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:629/0 lens 504/0 e 0 to 0 dl 1789518239 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518228.934643:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303f4d880 with x1876445501692288 ext(0->12) 00002000:00010000:1.0:1789518228.934649:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303f4d880 00000100:00100000:1.0:1789518228.934685:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:1.0:1789518228.934695:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+9:2388:x1876445501692288:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518228.935384:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9516:1876445522714240:192.168.202.43@tcp:105: 00010000:00010000:0.0:1789518228.935410:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518228.935478:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+11:2387:x1876445501692160:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 5138us (5794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.935489:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:3.0:1789518228.937418:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5499dd84-083f-4a57-a16b-aad857025063+10:2388:x1876445501692288:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 2713us (3114us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789518228.937441:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00002000:00100000:3.0:1789518228.937456:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8e7303f4d880 x1876445501692288/t4294967322(0) o4->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:629/0 lens 504/448 e 0 to 0 dl 1789518239 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518228.937485:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303f4d880 with x1876445501692288 ext(0->12) 00002000:00010000:3.0:1789518228.937492:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303f4d880 00000100:00100000:3.0:1789518228.945203:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518228.945420:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501692416 00000100:00100000:2.0:1789518228.945434:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501692416 00000100:00100000:2.0:1789518228.945613:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 243 00000100:00100000:2.0:1789518228.945626:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+26:12439:x1876445501692416:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518228.952114:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1789518228.952138:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789518228.952185:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789518228.952223:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:3.0:1789518228.952239:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1789518228.952503:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518228.952541:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522714368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518228.952635:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518228.952723:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522714368 00000100:00100000:0.0:1789518228.952734:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522714368 00000100:00100000:0.0:1789518228.952807:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789518228.952818:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522714368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789518228.952972:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789518228.952977:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789518228 00002000:00010000:0.0:1789518228.952980:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518228.952983:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789518228 -> 1789518228 00002000:00010000:0.0:1789518228.952985:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789518228.953030:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876445522714368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (395us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789518228.953038:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789518228.953086:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967320 gen 2 00000004:00080000:0.0:1789518228.953092:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967320 00000004:00080000:0.0:1789518228.953124:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7303f4f800, transno 4294967320 00000100:00100000:0.0:1789518228.953137:0:3639:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e7435e92680 x1876445522714368/t4294967323(4294967323) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518244 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789518228.953150:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7435e92680/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789518228.953156:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522714368:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789518228.953891:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.953903:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.953924:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.953931:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518228.953936:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.953946:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.953965:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:2.0:1789518228.954089:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518228.954097:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.954104:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3200/0x8d0fd6794231520a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518228.954242:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501692416:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 8617us (9062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.954251:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 243 00000100:00100000:1.0:1789518228.958326:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.958694:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501692544 00000100:00100000:0.0:1789518228.958708:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501692544 00000100:00100000:0.0:1789518228.958788:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:0.0:1789518228.958801:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+10:2390:x1876445501692544:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789518228.964610:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789518228.964633:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1789518228.964865:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2390:x1876445501692544:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 6059us (6544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.964880:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:1.0:1789518228.974448:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.974632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501692800 00000100:00100000:0.0:1789518228.974656:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501692800 00000100:00100000:0.0:1789518228.974734:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 244 00000100:00100000:0.0:1789518228.974746:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501692800:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518228.974833:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518228.974871:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231521f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856644e expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.974896:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:0.0:1789518228.974902:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518228.974943:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.974961:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.974998:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518228.975163:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081557706 reply state 0000000088a29e25 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.975178:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.975185:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:0.0:1789518228.975188:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518228.975410:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518228.975656:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+22:12439:x1876445501692800:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 911us (1220us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1789518228.975664:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 244 00000100:00100000:3.0:1789518228.978094:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.978208:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501692928 00000100:00100000:0.0:1789518228.978218:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501692928 00000100:00100000:0.0:1789518228.978324:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:0.0:1789518228.978345:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501692928:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518228.978585:0:9982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789518228.978590:0:9982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789518228 -> 1789518227 00002000:00010000:0.0:1789518228.978592:0:9982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789518227 00002000:00010000:0.0:1789518228.978594:0:9982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789518228 -> 1789518227 00002000:00010000:0.0:1789518228.978596:0:9982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789518228.978859:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501692928:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 524us (775us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789518228.978868:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:2.0:1789518228.990751:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518228.990996:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501693184 00000100:00100000:3.0:1789518228.991010:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501693184 00000100:00100000:3.0:1789518228.991135:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 245 00000100:00100000:3.0:1789518228.991148:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+22:12439:x1876445501693184:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789518228.991248:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.991270:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 22 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.991281:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.991325:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 22 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.991353:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 22 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518228.991371:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522714496:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518228.991578:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518228.995931:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518228.996513:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522714496:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518228.996563:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518228.996693:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501693312 00000100:00100000:2.0:1789518228.996704:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501693312 00010000:00010000:2.0:1789518228.996750:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 23 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518228.996805:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:2.0:1789518228.996816:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+23:2388:x1876445501693312:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518228.996854:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518228.996864:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 23 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.996876:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 23 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.996902:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ade00/0x8d0fd67942315203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566440 expref: 23 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.996920:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:2.0:1789518228.996925:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.996936:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.996945:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.996979:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518228.997051:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5499dd84-083f-4a57-a16b-aad857025063+22:2388:x1876445501693312:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 236us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.997059:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00010000:00010000:0.0:1789518228.997149:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997157:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997210:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997218:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997226:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997233:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c2400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518228.997237:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997246:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997256:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:0.0:1789518228.997259:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789518228.997262:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.997269:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2400/0x8d0fd6794231523b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518228.997326:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501693184:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 6181us (6592us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789518228.997348:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 245 00000100:00100000:2.0:1789518229.006615:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518229.006723:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501693440 00000100:00100000:0.0:1789518229.006736:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501693440 00000100:00100000:0.0:1789518229.006820:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:0.0:1789518229.006834:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2388:x1876445501693440:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789518229.006895:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.006922:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.006932:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518229.006938:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518229.006944:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.006989:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 8 pid: 9982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.007007:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 8 pid: 9982 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.007026:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1876445522714624:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518229.007208:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518229.012165:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518229.012272:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501693568 00000100:00100000:2.0:1789518229.012286:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501693568 00010000:00010000:2.0:1789518229.012348:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 9 pid: 9982 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518229.012429:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:2.0:1789518229.012441:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501693568:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518229.012460:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518229.012534:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 9 pid: 9982 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.012551:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 9 pid: 9982 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.012583:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518229.012588:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518229.012596:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.012607:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.012633:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518229.012694:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+9:2387:x1876445501693568:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 255us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.012702:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 100 00010000:00010000:0.0:1789518229.013579:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c86cf8e6/0x8d0fd6794231522d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856645c expref: 8 pid: 9982 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.013600:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1876445522714624:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518229.013627:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013638:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013646:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013672:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013681:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013690:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013697:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518229.013702:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013729:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013744:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.013753:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0af99da/0x8d0fd67942315242 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.014754:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501693440:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 7918us (8148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518229.014766:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:1.0:1789518229.021054:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518229.021154:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501693824 00000100:00100000:2.0:1789518229.021167:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501693824 00000100:00100000:0.0:1789518229.021420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 246 00000100:00100000:0.0:1789518229.021434:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+21:12439:x1876445501693824:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518229.021586:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.021607:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 21 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.021619:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.021664:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 21 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.021703:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 21 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.021721:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522714752:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518229.021996:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a9c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789518229.022664:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518229.023613:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522714752:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518229.023643:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518229.034379:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518229.034709:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501693952 00000100:00100000:3.0:1789518229.034723:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501693952 00010000:00010000:3.0:1789518229.034791:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 22 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518229.034850:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 101 00000100:00100000:3.0:1789518229.034863:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+22:2387:x1876445501693952:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518229.034882:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518229.034890:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 22 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.034906:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 22 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.034934:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ace00/0x8d0fd67942315138 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566408 expref: 22 pid: 14668 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.034956:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518229.034964:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 21 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.034978:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.034987:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.034997:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.035063:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518229.035134:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+21:2387:x1876445501693952:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 274us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.035143:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 101 00010000:00010000:0.0:1789518229.036100:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.036114:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.036457:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.036516:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 21 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.036536:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.036578:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 21 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.036594:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 21 pid: 8781 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.036628:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522714880:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518229.036719:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518229.039145:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518229.039272:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522714880:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518229.039304:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518229.039441:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501694080 00000100:00100000:2.0:1789518229.039451:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501694080 00010000:00010000:2.0:1789518229.039558:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 22 pid: 8781 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518229.039643:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 102 00000100:00100000:2.0:1789518229.039654:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+22:2388:x1876445501694080:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518229.039672:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518229.039679:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 22 pid: 8781 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.039694:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 22 pid: 8781 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.039719:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6a00/0x8d0fd67942315211 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566447 expref: 22 pid: 8781 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.039739:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:2.0:1789518229.039745:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.039757:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.039766:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.039817:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518229.039883:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5499dd84-083f-4a57-a16b-aad857025063+21:2388:x1876445501694080:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 229us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.039892:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 102 00010000:00010000:0.0:1789518229.042160:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.042180:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518229.042347:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789518229.042563:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789518229.042605:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789518229.042716:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1876445522715008:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518229.042908:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518229.042956:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518229.044704:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522715008 00000100:00100000:3.0:1789518229.044721:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522715008 00000100:00100000:3.0:1789518229.044812:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789518229.044826:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74420e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1876445522715008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789518229.044993:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74420e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1876445522715008:12345-0@lo:1000:mdt00_002.0 Request processed in 169us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.045002:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789518229.046967:0:6515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1789518229.046979:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7435e92680, transno 4294967323 00000100:00100000:0.0:1789518229.047008:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1876445522715008:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789518229.047210:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789518229.047302:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1876445522715136:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518229.047377:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518229.047422:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522715136 00000100:00100000:0.0:1789518229.047429:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522715136 00000100:00100000:0.0:1789518229.047511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789518229.047521:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1876445522715136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518229.047673:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1876445522715136:12345-0@lo:1000:mdt00_002.0 Request processed in 153us (296us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789518229.047687:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789518229.047721:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518229.047742:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6515:1876445522715136:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789518229.047790:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047812:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047820:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047827:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518229.047833:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047842:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047862:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:0.0:1789518229.047866:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518229.047871:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047878:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd67942315250 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047921:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047927:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047934:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047940:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740165d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518229.047943:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047949:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047957:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518229.047960:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518229.047968:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 24 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047982:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 24 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.047992:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 24 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.048019:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 24 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.048042:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522715264:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789518229.048121:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518229.052090:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518229.052172:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501694208 00000100:00100000:2.0:1789518229.052184:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501694208 00000100:00100000:2.0:1789518229.052252:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:2.0:1789518229.052264:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+25:12437:x1876445501694208:12345-192.168.202.43@tcp:49:lfs.0 00000100:00100000:2.0:1789518229.052438:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+25:12437:x1876445501694208:12345-192.168.202.43@tcp:49:lfs.0 Request processed in 176us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.052448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:0.0:1789518229.052683:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1876445522715264:192.168.202.43@tcp:105: 00010000:00010000:0.0:1789518229.052716:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052728:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740165d400/0x8d0fd67942315193 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052778:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052797:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052811:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052823:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052830:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052838:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052845:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518229.052849:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052875:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052890:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518229.052893:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518229.052897:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052904:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315257 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052916:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052923:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052930:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052935:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518229.052938:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052945:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052953:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518229.052956:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518229.052959:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.052976:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7400/0x8d0fd67942315249 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.053142:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+24:12439:x1876445501693824:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 31711us (32100us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789518229.053153:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 246 00000020:00080000:0.0:1789518229.053158:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789518229.053446:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518229.053452:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518229.054023:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789518229.054034:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789518229.060710:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518229.060761:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518229.061073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501694720 00000100:00100000:2.0:1789518229.061088:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501694720 00000100:00100000:2.0:1789518229.061161:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:2.0:1789518229.061173:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+24:12439:x1876445501694720:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518229.064254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501694464 00000100:00100000:3.0:1789518229.064274:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501694464 00000100:00100000:3.0:1789518229.064359:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 247 00000100:00100000:3.0:1789518229.064371:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+26:12437:x1876445501694464:12345-192.168.202.43@tcp:58:lfs.0 00000040:00080000:3.0:1789518229.064620:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789518229.064747:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+26:12437:x1876445501694464:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 378us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.064756:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 247 00000004:00080000:2.0:1789518229.065684:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789518229.065744:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789518229.065820:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.065841:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.065855:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.065866:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.065897:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.065904:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.065931:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518229.065955:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518229.065963:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518229.065971:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad200 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518229.065976:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518229.065985:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518229.065998:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:1.0:1789518229.066001:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1789518229.066008:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+26:12439:x1876445501694720:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 4837us (5245us total) trans 4294967516 rc 0/0 00010000:00010000:1.0:1789518229.066008:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518229.066017:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00010000:00010000:1.0:1789518229.066020:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd6794231525e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789518229.066022:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518229.066035:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518229.066037:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518229.066039:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518229.124098:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518229.129850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501694848 00000100:00100000:0.0:1789518229.129872:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501694848 00000100:00100000:0.0:1789518229.129973:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 248 00000100:00100000:0.0:1789518229.130144:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+26:12441:x1876445501694848:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789518229.130180:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518229.130208:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315265 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566463 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130292:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130321:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130334:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130352:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130360:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130391:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130533:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130546:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130555:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130599:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.130613:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 27 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518229.130629:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522715392:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518229.130760:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518229.133650:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518229.133818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501695104 00000100:00100000:1.0:1789518229.133830:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501695104 00000100:00100000:1.0:1789518229.133895:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:1.0:1789518229.133907:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+28:6160:x1876445501695104:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789518229.133926:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1876445522715392:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518229.133959:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518229.135484:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+29:6160:x1876445501695104:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 1558us (1825us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789518229.135496:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:1.0:1789518229.137617:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518229.137709:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501695232 00000100:00100000:3.0:1789518229.137722:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501695232 00010000:00010000:3.0:1789518229.137771:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 29 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518229.137843:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 103 00000100:00100000:3.0:1789518229.137855:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+29:2387:x1876445501695232:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518229.137873:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518229.137881:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 29 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.137896:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 29 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.137925:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd67942315185 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566424 expref: 29 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.137946:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518229.137952:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.137964:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.137973:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.138015:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518229.138081:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5499dd84-083f-4a57-a16b-aad857025063+28:2387:x1876445501695232:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 229us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.138089:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 103 00010000:00010000:0.0:1789518229.139644:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139663:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518229.139754:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789518229.139760:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518229.139804:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139823:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139834:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139841:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139849:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139855:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518229.139860:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139869:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139883:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:0.0:1789518229.139886:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518229.139891:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139898:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7000/0x8d0fd6794231526c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139926:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139933:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139940:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139946:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518229.139949:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139956:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139965:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8e7303359b00) 00010000:00010000:0.0:1789518229.139969:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518229.139973:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.139980:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6600/0x8d0fd67942315273 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.140126:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd67942315265 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566463 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.140143:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566463 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518229.140163:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518229.140166:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518229.140169:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7a00, rc 0) 00000100:00100000:0.0:1789518229.140248:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+27:12441:x1876445501694848:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 10263us (16164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518229.140257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 248 00010000:00010000:0.0:1789518229.557852:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518230.012848:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518230.012868:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522715520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518230.012934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518230.012994:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522715520 00000100:00100000:0.0:1789518230.013001:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522715520 00000100:00100000:0.0:1789518230.013054:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789518230.013063:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522715520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789518230.013089:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518230.013143:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522715520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518230.013150:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1789518230.013170:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518230.013422:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522715520:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1789518230.071767:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518230.071781:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518230.071819:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789518230.071825:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789518230.071959:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522715648:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518230.072052:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74053dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518230.078428:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13792:1876445522715648:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518230.085653:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518230.086949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501695360 00000100:00100000:2.0:1789518230.086963:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501695360 00000100:00100000:2.0:1789518230.087039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 249 00000100:00100000:2.0:1789518230.087052:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:12452:x1876445501695360:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518230.087090:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518230.087233:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+27:12452:x1876445501695360:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 184us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518230.087241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 249 00000100:00100000:0.0:1789518230.105423:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518230.105473:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501695616 00000100:00100000:0.0:1789518230.105483:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501695616 00000100:00100000:0.0:1789518230.105545:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 250 00000100:00100000:0.0:1789518230.105562:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+27:12452:x1876445501695616:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518230.105584:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518230.105602:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942315281 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856646a expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.105716:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315288 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.105732:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.105745:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518230.105757:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789518230.105877:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7c00/0x8d0fd67942315281 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856646a expref: 30 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.105895:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856646a expref: 29 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.105904:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518230.105907:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518230.105910:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7200, rc 0) 00000100:00100000:0.0:1789518230.105966:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+29:12452:x1876445501695616:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 405us (552us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789518230.105974:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 250 00000100:00100000:0.0:1789518230.116701:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518230.116788:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518230.116826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501696000 00000100:00100000:0.0:1789518230.116836:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501696000 00000100:00100000:0.0:1789518230.116894:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 251 00000100:00100000:0.0:1789518230.116903:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+29:12452:x1876445501696000:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518230.116983:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117001:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117014:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117172:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117180:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117187:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117207:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518230.117372:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117385:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117399:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518230.117402:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518230.117415:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.117423:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6200/0x8d0fd67942315296 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518230.117570:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+30:12452:x1876445501696000:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 666us (780us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789518230.117579:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 251 00000040:00080000:0.0:1789518230.117684:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518230.117689:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518230.118169:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789518230.118180:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518230.127386:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501695744 00000100:00100000:0.0:1789518230.127402:0:9516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501695744 00000100:00100000:0.0:1789518230.127496:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:0.0:1789518230.127507:0:9516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7405e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+30:2390:x1876445501695744:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518230.127539:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518230.127566:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7200/0x8d0fd67942315288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856646a expref: 30 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.127586:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:0.0:1789518230.127592:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518230.128406:0:9516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7405e0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5499dd84-083f-4a57-a16b-aad857025063+29:2390:x1876445501695744:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 897us (11709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518230.128417:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789518230.140625:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518230.141360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501696256 00000100:00100000:2.0:1789518230.141372:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501696256 00000100:00100000:2.0:1789518230.141436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:2.0:1789518230.141447:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+29:12452:x1876445501696256:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518230.141727:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+30:12452:x1876445501696256:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 281us (1110us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789518230.141735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000040:00080000:3.0:1789518230.150936:0:14707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518230.150944:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518230.150974:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789518230.150979:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789518230.421227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518230.421269:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518230.421293:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518230.421311:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518230.421325:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518230.421341:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518230.421374:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518230.421402:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501696640 00000100:00100000:1.0:1789518230.421410:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501696640 00000100:00100000:1.0:1789518230.421454:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 391 00000100:00100000:1.0:1789518230.421484:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501696640:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518230.421576:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2387:x1876445501696640:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 113us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518230.421584:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 391 00000100:00100000:1.0:1789518230.421620:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501696896 00000100:00100000:1.0:1789518230.421624:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501696896 00000100:00100000:1.0:1789518230.421660:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697024 00000100:00100000:1.0:1789518230.421663:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697024 00000100:00100000:1.0:1789518230.421684:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:1.0:1789518230.421691:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501696896:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518230.421719:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501696896:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518230.421724:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:1.0:1789518230.421735:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 148 00000100:00100000:1.0:1789518230.421741:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501697024:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518230.421761:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501697024:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 20us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518230.421766:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 148 00000100:00100000:1.0:1789518230.421782:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501696512 00000100:00100000:1.0:1789518230.421785:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501696512 00000100:00100000:1.0:1789518230.421809:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697152 00000100:00100000:1.0:1789518230.421812:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697152 00000100:00100000:1.0:1789518230.421827:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501696768 00000100:00100000:1.0:1789518230.421830:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501696768 00000100:00100000:1.0:1789518230.421840:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697280 00000100:00100000:1.0:1789518230.421842:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697280 00000100:00100000:1.0:1789518230.421855:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 339 00000100:00100000:1.0:1789518230.421861:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501697152:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518230.421894:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501697152:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518230.421900:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 339 00000100:00100000:1.0:1789518230.421913:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 340 00000100:00100000:1.0:1789518230.421918:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501696768:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518230.421941:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2387:x1876445501696768:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518230.421947:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 340 00000100:00100000:1.0:1789518230.421956:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 341 00000100:00100000:1.0:1789518230.421962:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501697280:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518230.421984:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2387:x1876445501697280:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 22us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518230.421989:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 341 00000100:00100000:1.0:1789518230.422003:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 252 00000100:00100000:1.0:1789518230.422009:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+30:12465:x1876445501696512:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518230.422023:0:8781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518230.422043:0:8781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd6794231529d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566471 expref: -99 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518230.422149:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd679423152a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518230.422164:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd679423152a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518230.422187:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd679423152a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518230.422200:0:8781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789518230.422319:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c200/0x8d0fd6794231529d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566471 expref: 33 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518230.422339:0:8781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd679423152a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566471 expref: 32 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518230.422347:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:1.0:1789518230.422350:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789518230.422354:0:8781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d600, rc 0) 00000100:00100000:1.0:1789518230.422377:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+32:12465:x1876445501696512:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 367us (1156us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789518230.422383:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 252 00000100:00080000:1.0:1789518230.422565:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518230.422570:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518230.422573:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518230.422575:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518230.427631:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518230.427673:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697408 00000100:00100000:3.0:1789518230.427683:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697408 00000100:00100000:3.0:1789518230.427734:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 253 00000100:00100000:3.0:1789518230.427743:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+32:12465:x1876445501697408:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:3.0:1789518230.427806:0:8781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427823:0:8781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427834:0:8781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427869:0:8781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427876:0:8781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427899:0:8781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427905:0:8781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c2e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518230.427909:0:8781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427916:0:8781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427929:0:8781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518230.427932:0:8781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518230.427937:0:8781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518230.427942:0:8781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2e00/0x8d0fd679423152b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518230.428014:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+32:12465:x1876445501697408:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 270us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518230.428023:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 253 00000100:00100000:1.0:1789518230.575866:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518230.576157:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697536 00000100:00100000:0.0:1789518230.576167:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697536 00000100:00100000:0.0:1789518230.576239:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:0.0:1789518230.576264:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2387:x1876445501697536:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:0.0:1789518230.576283:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518230.576304:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0bbf4c2/0x8d0fd679423152b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566478 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518230.576329:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa9e193, atime: 0x6aa9e193, ctime: 0x6aa9e193, blocks: 0x8 00010000:00010000:0.0:1789518230.576349:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1789518230.576354:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518230.576362:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0bbf4c2/0x8d0fd679423152b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566478 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.576380:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0bbf4c2/0x8d0fd679423152b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566478 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518230.576393:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7200, rc 0) 00000100:00100000:0.0:1789518230.576550:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2387:x1876445501697536:12345-192.168.202.43@tcp:101:cat.0 Request processed in 287us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518230.576557:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00010000:00010000:1.0:1789518230.581976:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518230.582871:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518230.583175:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697664 00000100:00100000:0.0:1789518230.583194:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697664 00002000:00100000:0.0:1789518230.583263:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8e7303f4c700 x1876445501697664/t0(0) o3->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:631/0 lens 488/0 e 0 to 0 dl 1789518241 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518230.583274:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303f4c700 with x1876445501697664 ext(0->4095) 00002000:00010000:0.0:1789518230.583280:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303f4c700 00000100:00100000:0.0:1789518230.583309:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789518230.583318:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2390:x1876445501697664:12345-192.168.202.43@tcp:3:cat.0 00000100:00100000:0.0:1789518230.583757:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5499dd84-083f-4a57-a16b-aad857025063+8:2390:x1876445501697664:12345-192.168.202.43@tcp:3:cat.0 Request processed in 438us (890us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518230.583765:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00002000:00100000:0.0:1789518230.583772:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8e7303f4c700 x1876445501697664/t0(0) o3->5499dd84-083f-4a57-a16b-aad857025063@192.168.202.43@tcp:631/0 lens 488/4536 e 0 to 0 dl 1789518241 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518230.583780:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e7303f4c700 with x1876445501697664 ext(0->4095) 00002000:00010000:0.0:1789518230.583784:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e7303f4c700 00000100:00100000:0.0:1789518231.541962:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522715776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518231.542044:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518231.542161:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522715776 00000100:00100000:3.0:1789518231.542182:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522715776 00000100:00100000:3.0:1789518231.542265:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789518231.542274:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522715776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518231.542301:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789518231.542346:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522715776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518231.542369:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789518231.542701:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522715776:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789518231.544796:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518231.545025:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522716288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518231.545098:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518231.545135:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522716800:0@lo:400:kworker.0 00000100:00100000:0.0:1789518231.545156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518231.545185:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522717312:0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545485:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522716160:0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545526:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518231.545546:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522716672:0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518231.545601:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522717184:0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545622:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518231.545654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716288 00000100:00100000:1.0:1789518231.545661:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716288 00000100:00100000:1.0:1789518231.545713:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716800 00000100:00100000:1.0:1789518231.545718:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716800 00000100:00100000:1.0:1789518231.545741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716672 00000100:00100000:1.0:1789518231.545744:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716672 00000100:00100000:1.0:1789518231.545754:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717184 00000100:00100000:1.0:1789518231.545757:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717184 00000100:00100000:1.0:1789518231.545771:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789518231.545777:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522716288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545823:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522716288:12345-0@lo:400:kworker.0 Request processed in 45us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518231.545830:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789518231.545846:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789518231.545853:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522716800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545879:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522716800:12345-0@lo:400:kworker.0 Request processed in 27us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518231.545885:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789518231.545895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789518231.545901:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522716672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545934:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522716672:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518231.545939:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789518231.545950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789518231.545956:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522717184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.545992:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522717184:12345-0@lo:400:kworker.0 Request processed in 37us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518231.545998:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:1.0:1789518231.546019:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518231.546023:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518231.546057:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522716672:0@lo:400:kworker.0 00010000:00080000:1.0:1789518231.546070:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e74079d1c00 x1876445522717184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518231.546079:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522717184:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.546632:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522715904:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.546670:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518231.546711:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522716416:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.546735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518231.546756:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522716928:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.546780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518231.546799:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789518231.546805:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522716032:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.546827:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518231.546844:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522716544:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.546864:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518231.546883:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522717056:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.546903:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518231.546928:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716160 00000100:00100000:2.0:1789518231.546933:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716160 00000100:00100000:2.0:1789518231.546962:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716416 00000100:00100000:2.0:1789518231.546965:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716416 00000100:00100000:2.0:1789518231.546979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789518231.546985:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522716160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547025:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522716160:12345-0@lo:400:kworker.0 Request processed in 40us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518231.547032:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789518231.547047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789518231.547053:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522716416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547083:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522716416:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518231.547098:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789518231.547116:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716928 00000100:00100000:2.0:1789518231.547119:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716928 00000100:00100000:2.0:1789518231.547139:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716544 00000100:00100000:2.0:1789518231.547141:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716544 00000100:00100000:2.0:1789518231.547165:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789518231.547171:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522716928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547201:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522716928:12345-0@lo:400:kworker.0 Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518231.547207:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789518231.547218:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789518231.547224:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1876445522716544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547390:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1876445522716544:12345-0@lo:400:kworker.0 Request processed in 165us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518231.547396:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1789518231.547412:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518231.547441:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522716160:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547493:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522716544:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547513:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522716416:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547523:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522716928:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547550:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522716032 00000100:00100000:2.0:1789518231.547554:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522716032 00000100:00100000:2.0:1789518231.547573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717056 00000100:00100000:2.0:1789518231.547576:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717056 00000100:00100000:2.0:1789518231.547596:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789518231.547610:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522716032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547647:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522716032:12345-0@lo:400:kworker.0 Request processed in 38us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518231.547653:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789518231.547666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789518231.547671:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522717056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547698:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522717056:12345-0@lo:400:kworker.0 Request processed in 27us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518231.547703:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:2.0:1789518231.547717:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518231.547733:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522716032:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.547743:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522717056:0@lo:400:kworker.0 00000100:00100000:0.0:1789518231.548245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518231.548296:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522716288:0@lo:400:kworker.0 00010000:00080000:0.0:1789518231.548309:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e74079d1880 x1876445522716800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518231.548319:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522716800:0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.549044:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717312 00000100:00100000:2.0:1789518231.549053:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717312 00000100:00100000:2.0:1789518231.549110:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789518231.549118:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522717312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518231.549186:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522717312:12345-0@lo:400:kworker.0 Request processed in 69us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518231.549193:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789518231.549536:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522715904 00000100:00100000:1.0:1789518231.549541:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522715904 00000100:00100000:1.0:1789518231.549580:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789518231.549587:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522715904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518231.549629:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522715904:12345-0@lo:400:kworker.0 Request processed in 43us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518231.549635:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789518231.549685:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522715904:0@lo:400:kworker.0 00000100:00080000:0.0:1789518231.550990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518231.551032:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522717312:0@lo:400:kworker.0 00010000:00010000:1.0:1789518231.610416:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518232.054736:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518232.054769:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522717440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518232.054862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518232.055355:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717440 00000100:00100000:0.0:1789518232.055367:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717440 00000100:00100000:0.0:1789518232.055437:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789518232.055448:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522717440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789518232.055517:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789518232.055582:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522717440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518232.055590:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789518232.055836:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522717440:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789518232.184259:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518232.184281:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518232.184309:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789518232.184323:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518232.565940:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518232.565973:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522717568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518232.566075:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518232.566334:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518232.566345:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522717696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518232.566379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518232.566418:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717696 00000100:00100000:0.0:1789518232.566428:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717696 00000100:00100000:0.0:1789518232.566514:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789518232.566526:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876445522717696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518232.566563:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518232.566617:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876445522717696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518232.566625:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789518232.566686:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522717696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518232.566923:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518232.566936:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522717824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518232.566974:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518232.567067:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717568 00000100:00100000:3.0:1789518232.567073:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717568 00000100:00100000:3.0:1789518232.567114:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717824 00000100:00100000:3.0:1789518232.567117:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717824 00000100:00100000:3.0:1789518232.567133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789518232.567141:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522717568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518232.567173:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518232.567222:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522717568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518232.567230:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789518232.567243:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789518232.567250:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522717824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518232.567269:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789518232.567301:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522717824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518232.567307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789518232.567390:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522717568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518232.567512:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522717824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789518232.634589:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518232.890108:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1789518233.086674:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789518233.086700:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:1.0:1789518233.655826:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518234.691266:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518235.133765:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522717952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518235.133880:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518235.135545:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522717952 00000100:00100000:2.0:1789518235.135562:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522717952 00000100:00100000:2.0:1789518235.135638:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789518235.135664:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522717952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518235.135712:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000001:00080000:1.0:1789518235.140118:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789518235.140174:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e740560a780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789518235.140180:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7418af8e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e740560acc0 00000020:00080000:1.0:1789518235.140184:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e7418af8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e73036b0c00 00000100:00100000:2.0:1789518235.142940:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522717952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7264us (9044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518235.142980:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1789518235.143033:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518235.144592:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522717952:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789518235.144698:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.144713:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.144722:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.144730:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518235.144736:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.145207:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.145231:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8e73010b9700) 00010000:00010000:3.0:1789518235.145234:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518235.145241:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.145248:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6c00/0x8d0fd67942315234 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789518235.145287:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789518235.145372:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1789518235.155357:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1789518235.155375:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:1.0:1789518235.551578:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518235.551635:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518235.551677:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518235.551719:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501698304 00000100:00100000:1.0:1789518235.551736:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501698304 00000100:00100000:1.0:1789518235.551835:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00100000:1.0:1789518235.551848:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501698304:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518235.551963:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2388:x1876445501698304:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.551972:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00080000:1.0:1789518235.551999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518235.552029:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518235.552055:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501698048 00000100:00100000:1.0:1789518235.552059:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501698048 00000100:00100000:1.0:1789518235.552091:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501698560 00000100:00100000:1.0:1789518235.552094:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501698560 00000100:00100000:1.0:1789518235.552112:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 348 00000100:00100000:1.0:1789518235.552119:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501698048:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.552262:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 349 00000100:00100000:3.0:1789518235.552273:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501698560:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.552309:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501698560:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 40us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.552336:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 349 00000100:00100000:3.0:1789518235.552377:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518235.552398:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518235.552428:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518235.552446:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697920 00000100:00100000:3.0:1789518235.552450:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697920 00000100:00100000:3.0:1789518235.552507:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501698432 00000100:00100000:3.0:1789518235.552511:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501698432 00000100:00100000:3.0:1789518235.552527:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 350 00000100:00100000:3.0:1789518235.552534:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+18:2388:x1876445501697920:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.552567:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+18:2388:x1876445501697920:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 33us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.552573:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 350 00000100:00100000:3.0:1789518235.552587:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 351 00000100:00100000:3.0:1789518235.552593:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501698432:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.552618:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2388:x1876445501698432:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.552624:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 351 00000100:00100000:3.0:1789518235.552649:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501698176 00000100:00100000:3.0:1789518235.552654:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501698176 00000100:00100000:3.0:1789518235.552685:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 153 00000100:00100000:3.0:1789518235.552690:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501698176:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.552716:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501698176:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.552722:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 153 00000100:00100000:0.0:1789518235.553310:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501697792 00000100:00100000:0.0:1789518235.553321:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501697792 00000100:00100000:0.0:1789518235.553374:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 393 00000100:00100000:0.0:1789518235.553383:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501697792:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518235.553428:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2388:x1876445501697792:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 47us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518235.553435:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 393 00000100:00080000:2.0:1789518235.553784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518235.553791:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518235.553794:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518235.556319:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2388:x1876445501698048:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 4181us (4664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.556339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 348 00010000:00010000:0.0:1789518235.701761:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518236.662387:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518236.662422:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522718080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518236.662562:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518236.662847:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718080 00000100:00100000:3.0:1789518236.662859:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718080 00000100:00100000:3.0:1789518236.662935:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789518236.662947:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522718080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518236.662989:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789518236.663048:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522718080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518236.663056:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1789518236.663130:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518236.663174:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1789518236.663182:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1789518236.663216:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522718080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518236.663724:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522718208:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.663771:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.663813:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522718720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.663839:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.663860:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522719232:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.663885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.663908:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789518236.663914:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522718336:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.663939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.663958:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522718848:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.663978:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664019:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522719360:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664075:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718720 00000100:00100000:2.0:1789518236.664082:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718720 00000100:00100000:2.0:1789518236.664126:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789518236.664134:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522718720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664182:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522718720:12345-0@lo:400:kworker.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.664189:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789518236.664214:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522719232 00000100:00100000:2.0:1789518236.664218:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522719232 00000100:00100000:2.0:1789518236.664245:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718848 00000100:00100000:2.0:1789518236.664248:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718848 00000100:00100000:2.0:1789518236.664274:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789518236.664281:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522719232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664312:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522719232:12345-0@lo:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.664319:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789518236.664331:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789518236.664337:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522718848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664363:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522718848:12345-0@lo:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.664369:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789518236.664387:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718336 00000100:00100000:2.0:1789518236.664390:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718336 00000100:00100000:2.0:1789518236.664415:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522719360 00000100:00100000:2.0:1789518236.664418:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522719360 00000100:00100000:2.0:1789518236.664436:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789518236.664451:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522718336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664524:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522718336:12345-0@lo:400:kworker.0 Request processed in 74us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.664531:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789518236.664544:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789518236.664550:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522719360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664579:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522719360:12345-0@lo:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.664585:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:2.0:1789518236.664623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518236.664627:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518236.664638:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522718464:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664668:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664690:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522718976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664728:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522719488:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664749:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664767:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789518236.664775:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522718592:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664797:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664813:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522719104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664833:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664847:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522719616:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664867:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.664896:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718464 00000100:00100000:2.0:1789518236.664908:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718464 00000100:00100000:2.0:1789518236.664934:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789518236.664940:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522718464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.664974:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522718464:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.664980:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789518236.664998:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718976 00000100:00100000:2.0:1789518236.665002:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718976 00000100:00100000:2.0:1789518236.665024:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522719488 00000100:00100000:2.0:1789518236.665027:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522719488 00000100:00100000:2.0:1789518236.665041:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718592 00000100:00100000:2.0:1789518236.665044:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718592 00000100:00100000:2.0:1789518236.665054:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522719104 00000100:00100000:2.0:1789518236.665056:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522719104 00000100:00100000:2.0:1789518236.665069:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789518236.665074:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522718976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665104:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522718976:12345-0@lo:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.665109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789518236.665122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789518236.665128:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522719488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665153:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522719488:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.665159:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789518236.665171:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789518236.665176:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522718592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665203:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522718592:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.665217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789518236.665230:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789518236.665236:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522719104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665266:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522719104:12345-0@lo:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.665271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789518236.665290:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522719616 00000100:00100000:2.0:1789518236.665293:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522719616 00000100:00100000:2.0:1789518236.665319:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789518236.665325:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522719616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665356:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522719616:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.665362:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789518236.665382:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518236.665386:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518236.665388:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518236.665428:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522718336:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665441:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789518236.665446:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789518236.665508:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7435e90700, transno 4294967311 00000100:00100000:2.0:1789518236.665524:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522718848:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665538:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522719360:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665549:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522718720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665560:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522719232:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665718:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522718592:0@lo:400:kworker.0 00010000:00080000:2.0:1789518236.665731:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e92680 x1876445522719104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518236.665741:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522719104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665749:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522719616:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665759:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522718464:0@lo:400:kworker.0 00000100:00100000:2.0:1789518236.665767:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522718976:0@lo:400:kworker.0 00010000:00080000:2.0:1789518236.665775:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e741073b800 x1876445522719488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518236.665782:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522719488:0@lo:400:kworker.0 00000100:00100000:1.0:1789518236.666450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522718208 00000100:00100000:1.0:1789518236.666492:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522718208 00000100:00100000:1.0:1789518236.666536:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789518236.666545:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522718208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518236.666619:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3637:x1876445522718208:12345-0@lo:400:kworker.0 Request processed in 75us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518236.666627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789518236.666718:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522718208:0@lo:400:kworker.0 00010000:00010000:1.0:1789518236.726292:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518237.173792:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522719744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518237.173895:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518237.174142:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522719744 00000100:00100000:2.0:1789518237.174153:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522719744 00000100:00100000:2.0:1789518237.174219:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789518237.174231:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522719744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518237.174271:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789518237.174327:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522719744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518237.174334:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789518237.174554:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522719744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518237.220211:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518237.220391:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501698688 00000100:00100000:2.0:1789518237.220407:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501698688 00000100:00100000:2.0:1789518237.220563:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 254 00000100:00100000:2.0:1789518237.220574:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:12118:x1876445501698688:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518237.220696:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5499dd84-083f-4a57-a16b-aad857025063+18:12118:x1876445501698688:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 Request processed in 126us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518237.220722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 254 00000100:00080000:0.0:1789518237.220815:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518237.224649:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518237.224757:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501698816 00000100:00100000:2.0:1789518237.224769:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501698816 00000100:00080000:0.0:1789518237.224846:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518237.224898:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 255 00000100:00100000:2.0:1789518237.224908:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:12118:x1876445501698816:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518237.225029:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5499dd84-083f-4a57-a16b-aad857025063+5:12118:x1876445501698816:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 Request processed in 123us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518237.225037:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 255 00000100:00100000:1.0:1789518237.235897:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518237.236019:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699072 00000100:00100000:2.0:1789518237.236033:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699072 00000100:00100000:2.0:1789518237.236133:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789518237.236146:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+18:12118:x1876445501699072:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518237.236535:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+19:12118:x1876445501699072:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 389us (654us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789518237.236544:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789518237.685774:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518237.685897:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518237.685922:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522720000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518237.686013:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518237.686135:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720000 00000100:00100000:3.0:1789518237.686154:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720000 00000100:00100000:3.0:1789518237.686214:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789518237.686224:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522720000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518237.686268:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518237.686322:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522720000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518237.686330:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789518237.686383:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522720000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518237.690397:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522720128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518237.690528:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518237.690716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720128 00000100:00100000:3.0:1789518237.690750:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720128 00000100:00100000:3.0:1789518237.690819:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789518237.690831:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522720128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518237.690891:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789518237.690966:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522720128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518237.690973:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789518237.691203:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522720128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518237.695460:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522719872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518237.695604:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518237.695791:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522719872 00000100:00100000:0.0:1789518237.695803:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522719872 00000100:00100000:0.0:1789518237.695889:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789518237.695901:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522719872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518237.695945:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518237.696019:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522719872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518237.696026:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789518237.699814:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522719872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518237.750197:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518238.777889:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518239.497752:0:14904:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:23:57 (1789518237) 00010000:00010000:0.0:1789518239.797821:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518240.246622:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522720256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518240.246717:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518240.249254:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720256 00000100:00100000:3.0:1789518240.249277:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720256 00000100:00100000:3.0:1789518240.249363:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789518240.249378:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522720256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518240.249434:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789518240.249575:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522720256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 201us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518240.249584:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789518240.251109:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518240.252321:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522720256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518240.661174:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518240.661216:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518240.661263:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518240.661285:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518240.661305:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518240.661341:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518240.661365:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518240.661398:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699200 00000100:00100000:2.0:1789518240.661411:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699200 00000100:00100000:2.0:1789518240.661531:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 395 00000100:00100000:2.0:1789518240.661543:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501699200:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518240.661633:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2389:x1876445501699200:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 92us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518240.661641:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 395 00000100:00100000:2.0:1789518240.661686:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699456 00000100:00100000:2.0:1789518240.661690:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699456 00000100:00100000:2.0:1789518240.661731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699968 00000100:00100000:2.0:1789518240.661734:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699968 00000100:00100000:2.0:1789518240.661749:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699328 00000100:00100000:2.0:1789518240.661751:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699328 00000100:00100000:2.0:1789518240.661764:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699840 00000100:00100000:2.0:1789518240.661766:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699840 00000100:00100000:2.0:1789518240.661780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 358 00000100:00100000:2.0:1789518240.661787:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501699456:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518240.661823:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501699456:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 36us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518240.661829:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 358 00000100:00100000:2.0:1789518240.661841:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 359 00000100:00100000:2.0:1789518240.661847:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501699968:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518240.661871:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501699968:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518240.661877:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 359 00000100:00100000:2.0:1789518240.661897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 360 00000100:00100000:2.0:1789518240.661903:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+19:2389:x1876445501699328:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518240.661942:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5499dd84-083f-4a57-a16b-aad857025063+19:2389:x1876445501699328:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 38us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518240.661948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 360 00000100:00100000:2.0:1789518240.661959:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 361 00000100:00100000:2.0:1789518240.661965:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501699840:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518240.661989:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2389:x1876445501699840:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518240.661995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 361 00000100:00100000:2.0:1789518240.662030:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699712 00000100:00100000:2.0:1789518240.662034:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699712 00000100:00100000:2.0:1789518240.662065:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501699584 00000100:00100000:2.0:1789518240.662068:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501699584 00000100:00100000:2.0:1789518240.662089:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 157 00000100:00100000:2.0:1789518240.662095:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2389:x1876445501699712:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518240.662121:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+7:2389:x1876445501699712:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518240.662127:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 157 00000100:00100000:2.0:1789518240.662138:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 158 00000100:00100000:2.0:1789518240.662143:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501699584:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518240.662164:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2389:x1876445501699584:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518240.662169:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 158 00000100:00080000:2.0:1789518240.662379:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518240.662385:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518240.662387:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518240.662389:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789518240.821702:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789518241.283407:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789518241.283435:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789518241.287665:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789518241.287688:0:6545:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1789518241.781710:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522720384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518241.781844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.781865:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522720512:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.781938:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522720896:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.781954:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.781996:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522721024:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.782032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.782056:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522721536:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.782079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.782105:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522722048:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.782127:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.782149:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789518241.782155:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522720640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.782176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.782191:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522721152:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.782209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.782227:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522721664:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.782247:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.782280:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721024 00000100:00100000:3.0:1789518241.782288:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721024 00000100:00100000:3.0:1789518241.782335:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789518241.782343:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522721024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.782398:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522721024:12345-0@lo:400:kworker.0 Request processed in 54us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518241.782419:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789518241.782460:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522721024:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.782816:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518241.782860:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522721408:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.782888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518241.782908:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522721920:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.782933:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518241.782976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720640 00000100:00100000:3.0:1789518241.782984:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720640 00000100:00100000:3.0:1789518241.783012:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721664 00000100:00100000:3.0:1789518241.783015:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721664 00000100:00100000:3.0:1789518241.783032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720896 00000100:00100000:3.0:1789518241.783034:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720896 00000100:00100000:3.0:1789518241.783045:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721408 00000100:00100000:3.0:1789518241.783048:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721408 00000100:00100000:3.0:1789518241.783061:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789518241.783067:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522720640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.783123:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522720640:12345-0@lo:400:kworker.0 Request processed in 56us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518241.783129:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789518241.783142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789518241.783147:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522721664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.783168:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876445522721664:12345-0@lo:400:kworker.0 Request processed in 21us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518241.783173:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789518241.783182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789518241.783186:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522720896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.783206:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522720896:12345-0@lo:400:kworker.0 Request processed in 20us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518241.783211:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789518241.783219:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789518241.783224:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522721408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.783244:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522721408:12345-0@lo:400:kworker.0 Request processed in 19us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518241.783250:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789518241.783283:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522720896:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.783289:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522720640:0@lo:400:kworker.0 00010000:00080000:1.0:1789518241.783323:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f9b9880 x1876445522721408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518241.783324:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1876445522721664:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.783350:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522721408:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.783372:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789518241.783382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522720768:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.783446:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518241.783510:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522721280:0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.783514:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720384 00000100:00100000:2.0:1789518241.783522:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720384 00000100:00100000:1.0:1789518241.783539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518241.783568:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522721792:0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.783584:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789518241.783599:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522720384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518241.783608:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789518241.783639:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789518241.783702:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522720384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.783708:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789518241.783731:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720512 00000100:00100000:2.0:1789518241.783735:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720512 00000100:00100000:2.0:1789518241.783760:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789518241.783766:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522720512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.783797:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522720512:12345-0@lo:400:kworker.0 Request processed in 31us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.783802:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789518241.783829:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721536 00000100:00100000:2.0:1789518241.783832:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721536 00000100:00100000:2.0:1789518241.783851:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722048 00000100:00100000:2.0:1789518241.783853:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722048 00000100:00100000:2.0:1789518241.783863:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721152 00000100:00100000:2.0:1789518241.783865:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721152 00000100:00100000:2.0:1789518241.783876:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721920 00000100:00100000:2.0:1789518241.783878:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721920 00000100:00100000:2.0:1789518241.783890:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789518241.783903:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522721536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.783940:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522721536:12345-0@lo:400:kworker.0 Request processed in 34us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.783948:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789518241.783961:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789518241.783966:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522722048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.783986:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522722048:12345-0@lo:400:kworker.0 Request processed in 21us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.783991:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789518241.783999:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789518241.784003:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522721152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.784021:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522721152:12345-0@lo:400:kworker.0 Request processed in 18us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.784027:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789518241.784034:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789518241.784039:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522721920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.784059:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522721920:12345-0@lo:400:kworker.0 Request processed in 20us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.784064:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789518241.784085:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721280 00000100:00100000:2.0:1789518241.784088:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721280 00000100:00100000:2.0:1789518241.784104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522721792 00000100:00100000:2.0:1789518241.784106:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522721792 00000100:00100000:2.0:1789518241.784117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789518241.784123:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522721280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.784145:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522721280:12345-0@lo:400:kworker.0 Request processed in 22us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.784156:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789518241.784165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789518241.784171:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522721792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.784195:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522721792:12345-0@lo:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518241.784200:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:2.0:1789518241.784230:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518241.784233:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518241.784235:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518241.784237:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518241.784255:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522720384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518241.784277:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522721152:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.784300:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522721280:0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.784301:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522720512:0@lo:400:kworker.0 00000100:00100000:2.0:1789518241.784343:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522721536:0@lo:400:kworker.0 00010000:00080000:1.0:1789518241.784343:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f9b8380 x1876445522721792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518241.784370:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522722048:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.784376:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522721792:0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.784497:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522720768 00000100:00100000:3.0:1789518241.784503:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522720768 00000100:00100000:3.0:1789518241.784530:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789518241.784535:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522720768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518241.784583:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522720768:12345-0@lo:400:kworker.0 Request processed in 47us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518241.784589:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789518241.784623:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522721920:0@lo:400:kworker.0 00000100:00100000:1.0:1789518241.784661:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522720768:0@lo:400:kworker.0 00010000:00010000:1.0:1789518241.849432:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518242.046075:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518242.046996:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501700096 00000100:00100000:2.0:1789518242.047012:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501700096 00000100:00100000:2.0:1789518242.047098:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 256 00000100:00100000:2.0:1789518242.047108:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:13138:x1876445501700096:12345-192.168.202.43@tcp:101:lsof.0 00010000:00010000:2.0:1789518242.047130:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518242.047153:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423152c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856647f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518242.047218:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423152c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518242.047264:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423152c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518242.047277:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423152c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518242.047327:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518242.047332:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518242.047371:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423152c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518242.047396:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad200/0x8d0fd679423152c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856647f expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518242.047432:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423152c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856647f expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518242.047440:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:2.0:1789518242.047443:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518242.047448:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033aca00, rc 0) 00000100:00100000:2.0:1789518242.047555:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:13138:x1876445501700096:12345-192.168.202.43@tcp:101:lsof.0 Request processed in 449us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518242.047563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 256 00000100:00080000:0.0:1789518242.051206:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789518242.102859:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789518242.293823:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518242.293851:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522722176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518242.293930:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518242.294172:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722176 00000100:00100000:0.0:1789518242.294181:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722176 00000100:00100000:0.0:1789518242.294236:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789518242.294246:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522722176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789518242.294273:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789518242.294335:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522722176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518242.294342:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789518242.294503:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522722176:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1789518242.422687:0:13792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518242.422697:0:13792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518242.422813:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789518242.422823:0:13792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518242.806313:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789518242.806338:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522722432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518242.806416:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518242.806501:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522722304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518242.806529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518242.806571:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522722560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518242.806593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518242.806720:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722304 00000100:00100000:1.0:1789518242.806730:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722304 00000100:00100000:1.0:1789518242.806787:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789518242.806797:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522722304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518242.806827:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789518242.806898:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522722304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518242.806906:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789518242.806971:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722432 00000100:00100000:2.0:1789518242.806973:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522722304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518242.806976:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722432 00000100:00100000:3.0:1789518242.807009:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722560 00000100:00100000:2.0:1789518242.807011:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789518242.807012:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722560 00000100:00100000:2.0:1789518242.807024:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522722432:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518242.807040:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789518242.807047:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522722560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518242.807050:0:10345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000004:00000024:3.0:1789518242.807062:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789518242.807106:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522722560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518242.807112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789518242.813952:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522722560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518242.814420:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522722432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7392us (7999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518242.814433:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789518242.814564:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522722432:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789518242.869865:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518243.893917:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518244.009601:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518244.018643:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501700352 00000100:00100000:0.0:1789518244.018662:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501700352 00000100:00100000:0.0:1789518244.018793:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:0.0:1789518244.018808:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+18:13139:x1876445501700352:12345-192.168.202.43@tcp:35:umount.0 00000100:00100000:0.0:1789518244.019442:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+19:13139:x1876445501700352:12345-192.168.202.43@tcp:35:umount.0 Request processed in 635us (9849us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789518244.019451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00080000:2.0:1789518244.019553:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518244.029574:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518244.029669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501700608 00000100:00100000:1.0:1789518244.029680:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501700608 00000100:00100000:1.0:1789518244.029725:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789518244.029735:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+19:13139:x1876445501700608:12345-192.168.202.43@tcp:35:umount.0 00000100:00100000:1.0:1789518244.030051:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+20:13139:x1876445501700608:12345-192.168.202.43@tcp:35:umount.0 Request processed in 317us (487us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789518244.030060:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:3.0:1789518244.039185:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518244.040041:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501700864 00000100:00100000:1.0:1789518244.040053:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501700864 00000100:00100000:1.0:1789518244.040112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:1.0:1789518244.040133:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e740562f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+20:13139:x1876445501700864:12345-192.168.202.43@tcp:35:umount.0 00000100:00100000:1.0:1789518244.041204:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e740562f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5499dd84-083f-4a57-a16b-aad857025063+21:13139:x1876445501700864:12345-192.168.202.43@tcp:35:umount.0 Request processed in 1079us (2023us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789518244.041215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:2.0:1789518244.048336:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518244.048453:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501701120 00000100:00100000:0.0:1789518244.048498:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501701120 00000100:00100000:0.0:1789518244.048553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:0.0:1789518244.048565:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+21:13139:x1876445501701120:12345-192.168.202.43@tcp:35:umount.0 00000100:00100000:0.0:1789518244.048894:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5499dd84-083f-4a57-a16b-aad857025063+22:13139:x1876445501701120:12345-192.168.202.43@tcp:35:umount.0 Request processed in 331us (576us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789518244.048899:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:2.0:1789518244.057032:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518244.057135:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501701248 00000100:00100000:3.0:1789518244.057146:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501701248 00000100:00100000:3.0:1789518244.057211:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:3.0:1789518244.057219:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:395607ea-c3c4-4708-8905-dac70dffbbe5+13:2390:x1876445501701248:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518244.057239:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518244.057260:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcea00/0x8d0fd6794231422e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fd9 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.057294:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518244.057353:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:395607ea-c3c4-4708-8905-dac70dffbbe5+12:2390:x1876445501701248:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518244.057359:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:3.0:1789518244.062301:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518244.062361:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518244.062569:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501701760 00000100:00100000:1.0:1789518244.062582:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501701760 00000100:00100000:1.0:1789518244.062658:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:1.0:1789518244.062669:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+7:2386:x1876445501701760:12345-192.168.202.43@tcp:9:umount.0 00000020:00000080:1.0:1789518244.062705:0:8429:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314840 00000020:00010000:1.0:1789518244.062713:0:8429:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e7303532800: total 0 00000100:00080000:1.0:1789518244.062718:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e7423638800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518244.062769:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789518244.062932:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5499dd84-083f-4a57-a16b-aad857025063+5:2386:x1876445501701760:12345-192.168.202.43@tcp:9:umount.0 Request processed in 264us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518244.062952:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 81 00000020:00010000:1.0:1789518244.062973:0:6501:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e7303532800: total 0 00010000:00010000:1.0:1789518244.062995:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7303532800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789518244.063046:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e5ccab1/0x8d0fd67942314bf8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856629c expref: 4 pid: 13804 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789518244.063188:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789518244.063266:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0bbf4c2/0x8d0fd679423152b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566478 expref: 3 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518244.063281:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7303532800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789518244.063295:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518244.063297:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518244.063299:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518244.063364:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501701376 00000100:00100000:2.0:1789518244.063370:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501701376 00000100:00100000:2.0:1789518244.063426:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:2.0:1789518244.063434:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:2387:x1876445501701376:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518244.063447:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518244.063458:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740166dc00/0x8d0fd679423141ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565f9a expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518244.063506:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518244.063531:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+11:2387:x1876445501701376:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 98us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518244.063539:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:2.0:1789518244.066944:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518244.067078:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501701888 00000100:00100000:3.0:1789518244.067089:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501701888 00000100:00100000:3.0:1789518244.067241:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:3.0:1789518244.067251:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:395607ea-c3c4-4708-8905-dac70dffbbe5+11:2389:x1876445501701888:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518244.067269:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518244.067288:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d200/0x8d0fd679423144ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660b2 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.067308:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518244.067680:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2389:x1876445501701888:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 428us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518244.067687:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:2.0:1789518244.078339:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518244.078673:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501702016 00000100:00100000:0.0:1789518244.078688:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501702016 00000100:00100000:0.0:1789518244.078763:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:0.0:1789518244.078776:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+5:2386:x1876445501702016:12345-192.168.202.43@tcp:9:umount.0 00000020:00000080:0.0:1789518244.078807:0:13804:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423145ca 00000100:00080000:0.0:1789518244.078818:0:13804:0:(import.c:65:import_set_state_nolock()) ffff8e74039e2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518244.078867:0:13804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:1.0:1789518244.079107:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518244.079497:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518244.079590:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5499dd84-083f-4a57-a16b-aad857025063+2:2386:x1876445501702016:12345-192.168.202.43@tcp:9:umount.0 Request processed in 816us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518244.079599:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:0.0:1789518244.090457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518244.091745:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703040 00000100:00100000:2.0:1789518244.091764:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703040 00000100:00100000:2.0:1789518244.091892:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 257 00000100:00100000:2.0:1789518244.091929:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+22:2386:x1876445501703040:12345-192.168.202.43@tcp:39:umount.0 00000020:00000080:2.0:1789518244.091977:0:14668:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423141fd 00000020:00010000:2.0:1789518244.092015:0:14668:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e7303532000: total 0 00000100:00080000:2.0:1789518244.092022:0:14668:0:(import.c:65:import_set_state_nolock()) ffff8e7303535000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518244.092066:0:14668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1789518244.092646:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5499dd84-083f-4a57-a16b-aad857025063+21:2386:x1876445501703040:12345-192.168.202.43@tcp:39:umount.0 Request processed in 717us (2200us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789518244.092657:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 257 00000020:00010000:3.0:1789518244.092969:0:6500:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e7303532000: total 0 00010000:00010000:3.0:1789518244.093056:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7303532000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789518244.093111:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518244.093115:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518244.093126:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd6794231527a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566463 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093169:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e73032ee000) 00010000:00010000:3.0:1789518244.093172:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518244.093177:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d200/0x8d0fd67942314545 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660c7 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093210:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518244.093212:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518244.093216:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942314bb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566287 expref: 18 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093243:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518244.093246:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518244.093251:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7e00/0x8d0fd67942314be3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566295 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093268:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518244.093270:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518244.093274:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231489b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785661b5 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093289:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:3.0:1789518244.093291:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518244.093295:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c600/0x8d0fd67942314c53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662b1 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093314:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518244.093317:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518244.093330:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d600/0x8d0fd679423152a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566471 expref: 14 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093349:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518244.093351:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518244.093356:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942314f5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566391 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093370:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e73010b9a00) 00010000:00010000:3.0:1789518244.093372:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518244.093377:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942314529 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660c0 expref: 12 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093405:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8e7303359800) 00010000:00010000:3.0:1789518244.093407:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518244.093411:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7600/0x8d0fd6794231519a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856642b expref: 11 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093424:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8e7435d04000) 00010000:00010000:3.0:1789518244.093426:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518244.093429:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7800/0x8d0fd67942314ad9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856624f expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093441:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8e7303359a00) 00010000:00010000:3.0:1789518244.093443:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518244.093446:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6400/0x8d0fd67942314c6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785662b8 expref: 9 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093459:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8e7435d04200) 00010000:00010000:3.0:1789518244.093505:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518244.093511:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423145a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660dc expref: 8 pid: 8781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518244.093532:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7303532000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789518244.093547:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518244.093549:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518244.093551:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518244.108155:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518244.108515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703168 00000100:00100000:3.0:1789518244.108527:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703168 00000100:00100000:3.0:1789518244.108608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 258 00000100:00100000:3.0:1789518244.108619:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+5:2386:x1876445501703168:12345-192.168.202.43@tcp:39:umount.0 00000020:00000080:3.0:1789518244.108657:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314204 00000100:00080000:3.0:1789518244.108678:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8e743f88e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518244.108712:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789518244.108887:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5499dd84-083f-4a57-a16b-aad857025063+3:2386:x1876445501703168:12345-192.168.202.43@tcp:39:umount.0 Request processed in 268us (743us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789518244.108897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 258 00010000:00010000:1.0:1789518244.109998:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518244.110698:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789518244.917831:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518245.365778:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522722688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518245.365859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518245.366009:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722688 00000100:00100000:2.0:1789518245.366019:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722688 00000100:00100000:2.0:1789518245.366100:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789518245.366110:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522722688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518245.366143:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518245.366191:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522722688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518245.366197:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1789518245.366388:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518245.366671:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522722688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518245.781598:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518245.781650:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518245.781685:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518245.781720:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703552 00000100:00100000:1.0:1789518245.781742:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703552 00000100:00100000:1.0:1789518245.781810:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703424 00000100:00100000:1.0:1789518245.781813:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703424 00000100:00100000:1.0:1789518245.781849:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 368 00000100:00100000:1.0:1789518245.781860:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501703552:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518245.782161:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2390:x1876445501703552:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 302us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518245.782170:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 368 00000100:00100000:1.0:1789518245.782189:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 369 00000100:00100000:1.0:1789518245.782195:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2390:x1876445501703424:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518245.782224:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2390:x1876445501703424:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518245.782229:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 369 00000100:00100000:3.0:1789518245.783125:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703296 00000100:00100000:3.0:1789518245.783135:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703296 00000100:00100000:3.0:1789518245.783187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 397 00000100:00100000:3.0:1789518245.783196:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501703296:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518245.783236:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2390:x1876445501703296:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 42us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518245.783242:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 397 00000100:00080000:3.0:1789518245.783274:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518245.783289:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789518245.943127:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518246.366276:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518246.366322:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518246.366359:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518246.366508:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703680 00000100:00100000:2.0:1789518246.366519:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703680 00000100:00100000:2.0:1789518246.366590:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703808 00000100:00100000:2.0:1789518246.366594:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703808 00000100:00100000:2.0:1789518246.366607:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501703936 00000100:00100000:2.0:1789518246.366609:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501703936 00000100:00100000:2.0:1789518246.366624:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:2.0:1789518246.366634:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+12:2388:x1876445501703680:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518246.366652:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518246.366690:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e73033ac800/0x8d0fd67942314300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fee expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518246.366711:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518246.366774:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+11:2388:x1876445501703680:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 141us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518246.366783:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:2.0:1789518246.366815:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:2.0:1789518246.366822:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+10:2387:x1876445501703808:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518246.366830:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518246.366849:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030400/0x8d0fd67942314307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856601f expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518246.366859:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518246.366878:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+9:2387:x1876445501703808:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 57us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518246.366884:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:2.0:1789518246.366897:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:2.0:1789518246.366904:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+8:2388:x1876445501703936:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518246.366911:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518246.366932:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcf800/0x8d0fd679423144f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785660ab expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518246.366942:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518246.366961:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:395607ea-c3c4-4708-8905-dac70dffbbe5+7:2388:x1876445501703936:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 57us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518246.366967:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:1.0:1789518246.369753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518246.369890:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501704192 00000100:00100000:0.0:1789518246.369905:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501704192 00000100:00100000:0.0:1789518246.369998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 259 00000100:00100000:0.0:1789518246.370012:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+6:2386:x1876445501704192:12345-192.168.202.43@tcp:39:umount.0 00000020:00000080:0.0:1789518246.370184:0:6513:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314315 00000020:00010000:0.0:1789518246.370198:0:6513:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e743f8af800: total 0 00000100:00080000:0.0:1789518246.370205:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8e743f8a9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518246.370264:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789518246.370571:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2386:x1876445501704192:12345-192.168.202.43@tcp:39:umount.0 Request processed in 560us (833us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789518246.370580:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 259 00000020:00010000:2.0:1789518246.370722:0:6501:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e743f8af800: total 0 00010000:00010000:2.0:1789518246.370728:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518246.370798:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e743f8af800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789518246.370843:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7435d04800) 00010000:00010000:2.0:1789518246.370847:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518246.370858:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033aca00/0x8d0fd679423152c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856647f expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518246.370886:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e743f8af800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789518246.370896:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518246.370899:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518246.370901:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518246.380149:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518246.380251:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501704320 00000100:00100000:0.0:1789518246.380268:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501704320 00000100:00100000:0.0:1789518246.380351:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 260 00000100:00100000:0.0:1789518246.380372:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+5:2386:x1876445501704320:12345-192.168.202.43@tcp:39:umount.0 00000020:00000080:0.0:1789518246.380426:0:14668:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231431c 00000100:00080000:0.0:1789518246.380444:0:14668:0:(import.c:65:import_set_state_nolock()) ffff8e743f8a8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518246.380575:0:14668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789518246.380843:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b5627b1d-cf97-43a8-8382-f16e6ba3aeed+3:2386:x1876445501704320:12345-192.168.202.43@tcp:39:umount.0 Request processed in 480us (709us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789518246.380854:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 260 00010000:00010000:1.0:1789518246.381496:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518246.412145:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518246.412333:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501704576 00000100:00100000:2.0:1789518246.412348:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501704576 00000100:00100000:2.0:1789518246.412455:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 398 00000100:00100000:2.0:1789518246.412502:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+7:2386:x1876445501704576:12345-192.168.202.43@tcp:251:umount.0 00000020:00000080:2.0:1789518246.412559:0:6507:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423141da 00000020:00010000:2.0:1789518246.412570:0:6507:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e730292b800: total 0 00000100:00080000:2.0:1789518246.412577:0:6507:0:(import.c:65:import_set_state_nolock()) ffff8e730292a800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789518246.412679:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:395607ea-c3c4-4708-8905-dac70dffbbe5+3:2386:x1876445501704576:12345-192.168.202.43@tcp:251:umount.0 Request processed in 213us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518246.412694:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 398 00000020:00010000:1.0:1789518246.412839:0:6500:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e730292b800: total 0 00010000:00010000:1.0:1789518246.412907:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e730292b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789518246.412963:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcee00/0x8d0fd67942314251 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78565fe0 expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518246.412980:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e730292b800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789518246.412991:0:6500:0:(genops.c:885:class_export_put()) final put ffff8e730292b800/395607ea-c3c4-4708-8905-dac70dffbbe5 00010000:00010000:1.0:1789518246.413012:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518246.413015:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518246.413044:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518246.413944:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e730292b800/395607ea-c3c4-4708-8905-dac70dffbbe5 for MGS 00000020:00000080:2.0:1789518246.414002:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e730292a800 for MGS 00000100:00100000:0.0:1789518246.907164:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522722816:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907272:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907335:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522723328:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907381:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907406:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522723840:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907434:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907456:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522724352:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907534:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789518246.907540:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522723200:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907565:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907585:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522723712:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907625:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907644:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522724224:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907666:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907703:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522723072:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907725:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907742:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522723584:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907777:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522724096:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907816:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789518246.907822:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522722944:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907864:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522723456:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907886:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907907:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522723968:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.907933:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518246.907961:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723328 00000100:00100000:0.0:1789518246.907972:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723328 00000100:00100000:0.0:1789518246.908027:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723072 00000100:00100000:0.0:1789518246.908031:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723072 00000100:00100000:0.0:1789518246.908052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789518246.908064:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522723328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908134:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522723328:12345-0@lo:400:kworker.0 Request processed in 72us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908142:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789518246.908174:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789518246.908180:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522723072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908213:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522723072:12345-0@lo:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908219:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789518246.908238:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723840 00000100:00100000:0.0:1789518246.908241:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723840 00000100:00100000:0.0:1789518246.908269:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724352 00000100:00100000:0.0:1789518246.908271:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724352 00000100:00100000:0.0:1789518246.908290:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724224 00000100:00100000:0.0:1789518246.908292:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724224 00000100:00100000:0.0:1789518246.908303:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723456 00000100:00100000:0.0:1789518246.908305:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723456 00000100:00100000:0.0:1789518246.908316:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789518246.908321:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522723840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908348:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522723840:12345-0@lo:400:kworker.0 Request processed in 27us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908354:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789518246.908376:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789518246.908381:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522724352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908405:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522724352:12345-0@lo:400:kworker.0 Request processed in 24us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908410:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789518246.908418:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789518246.908423:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522724224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908443:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522724224:12345-0@lo:400:kworker.0 Request processed in 21us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908457:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789518246.908490:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789518246.908496:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522723456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908519:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522723456:12345-0@lo:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908524:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789518246.908542:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723200 00000100:00100000:0.0:1789518246.908545:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723200 00000100:00100000:0.0:1789518246.908562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723712 00000100:00100000:0.0:1789518246.908564:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723712 00000100:00100000:0.0:1789518246.908573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723584 00000100:00100000:0.0:1789518246.908575:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723584 00000100:00100000:0.0:1789518246.908584:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724096 00000100:00100000:0.0:1789518246.908586:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724096 00000100:00100000:0.0:1789518246.908595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722944 00000100:00100000:0.0:1789518246.908597:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722944 00000100:00100000:0.0:1789518246.908605:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522723968 00000100:00100000:0.0:1789518246.908607:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522723968 00000100:00100000:0.0:1789518246.908619:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789518246.908625:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522723200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908650:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522723200:12345-0@lo:400:kworker.0 Request processed in 25us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789518246.908665:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789518246.908669:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522723712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908689:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522723712:12345-0@lo:400:kworker.0 Request processed in 20us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789518246.908709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789518246.908714:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522723584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908735:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522723584:12345-0@lo:400:kworker.0 Request processed in 21us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789518246.908748:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789518246.908752:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522724096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908771:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876445522724096:12345-0@lo:400:kworker.0 Request processed in 18us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789518246.908784:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789518246.908788:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522722944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908806:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522722944:12345-0@lo:400:kworker.0 Request processed in 18us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908811:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789518246.908818:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789518246.908823:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522723968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908841:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522723968:12345-0@lo:400:kworker.0 Request processed in 18us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518246.908846:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:0.0:1789518246.908890:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518246.908894:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518246.908896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518246.908898:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518246.908929:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522722944:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908939:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522723456:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908954:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522723968:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908964:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522723072:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.908973:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522723584:0@lo:400:kworker.0 00010000:00080000:0.0:1789518246.908986:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303db5c00 x1876445522724096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518246.908997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1876445522724096:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.909044:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522723200:0@lo:400:kworker.0 00010000:00080000:0.0:1789518246.909055:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303db7800 x1876445522723712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518246.909064:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522723712:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.909073:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522724224:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.909082:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522723328:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.909091:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522723840:0@lo:400:kworker.0 00000100:00100000:0.0:1789518246.909099:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522724352:0@lo:400:kworker.0 00000100:00100000:2.0:1789518246.911649:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522722816 00000100:00100000:2.0:1789518246.911670:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522722816 00000100:00100000:2.0:1789518246.911745:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789518246.911759:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522722816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518246.911895:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3640:x1876445522722816:12345-0@lo:400:kworker.0 Request processed in 140us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518246.911903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789518246.916325:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3640:1876445522722816:0@lo:400:kworker.0 00000100:00100000:3.0:1789518246.916642:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518246.916661:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522724480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518246.916746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518246.916806:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724480 00000100:00100000:3.0:1789518246.916814:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724480 00000100:00100000:3.0:1789518246.916873:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789518246.916884:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522724480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518246.916924:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789518246.916975:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522724480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518246.916983:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789518246.918214:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522724480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789518246.970329:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518247.415776:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522724608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518247.415844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518247.415919:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724608 00000100:00100000:2.0:1789518247.415927:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724608 00000100:00100000:2.0:1789518247.415971:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789518247.415980:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522724608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518247.416003:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789518247.416045:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522724608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518247.416051:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789518247.416097:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522724608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518247.925755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522724864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518247.925848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518247.925926:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518247.925934:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522724736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518247.925960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518247.925993:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724864 00000100:00100000:1.0:1789518247.926001:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724864 00000100:00100000:1.0:1789518247.926059:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724736 00000100:00100000:1.0:1789518247.926062:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724736 00000100:00100000:1.0:1789518247.926082:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789518247.926092:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522724864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518247.926129:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789518247.926178:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522724864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518247.926186:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789518247.926427:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789518247.926435:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522724736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518247.926453:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789518247.926527:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522724736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518247.926533:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789518247.927131:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522724736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518247.927151:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522724864:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1789518247.928274:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:00080000:1.0:1789518247.928299:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789518247.928304:0:6490:0:(genops.c:885:class_export_put()) final put ffff8e743f8af800/b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:00100000:1.0:1789518247.928389:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000001:00080000:1.0:1789518247.928396:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789518247.928405:0:6490:0:(genops.c:885:class_export_put()) final put ffff8e7303532000/5499dd84-083f-4a57-a16b-aad857025063 00000100:00100000:0.0:1789518247.928856:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522724992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518247.928944:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518247.929003:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522724992 00000100:00100000:0.0:1789518247.929009:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522724992 00000100:00100000:0.0:1789518247.929063:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789518247.929072:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522724992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518247.929108:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518247.929151:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522724992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518247.929158:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789518247.929400:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522724992:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789518247.929676:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743f8af800/b5627b1d-cf97-43a8-8382-f16e6ba3aeed for lustre-MDT0000 00000020:00000080:3.0:1789518247.929740:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e743f8a9800 for lustre-MDT0000 00000020:00000080:3.0:1789518247.930101:0:473:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7303532000/5499dd84-083f-4a57-a16b-aad857025063 for lustre-MDT0000 00000020:00000080:3.0:1789518247.930146:0:473:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7303535000 for lustre-MDT0000 00010000:00010000:1.0:1789518247.989899:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789518248.181662:0:15100:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789518248.219205:0:15100:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789518248.219270:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.219286:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.219294:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.219301:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.219340:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518248.219355:0:15100:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789518248.219386:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518248.219391:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789518248.219396:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789518248.219422:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e7405cc9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789518248.219712:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522725120:0@lo:39:umount.0 00000100:00100000:0.0:1789518248.219781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518248.219915:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518248.219923:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.219931:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcec00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518248.219936:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.219959:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518248.219967:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518248.219972:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518248.219975:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518248.219977:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518248.220004:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.220011:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789518248.220117:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522725120 00000100:00100000:2.0:1789518248.220124:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522725120 00000100:00100000:2.0:1789518248.220177:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789518248.220187:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876445522725120:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789518248.220213:0:6515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313df1 00000100:00080000:2.0:1789518248.220222:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8e74416e0800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789518248.220281:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1876445522725120:12345-0@lo:39:umount.0 Request processed in 95us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518248.220288:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1789518248.220297:0:6515:0:(genops.c:885:class_export_put()) final put ffff8e74416e4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789518248.220321:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74416e4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789518248.220379:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e74416e0800 for lustre-MDT0000 00010000:00010000:3.0:1789518248.220717:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.220725:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcec00/0x8d0fd67942314290 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314297 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.220740:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518248.220742:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518248.220744:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518248.220756:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522725248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518248.220793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518248.220839:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522725248 00000100:00100000:3.0:1789518248.220843:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522725248 00000100:00100000:3.0:1789518248.220877:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518248.220885:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7405e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3638:x1876445522725248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518248.220895:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518248.220916:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9d600/0x8d0fd67942314297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314290 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.220938:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518248.220968:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7405e0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:3638:x1876445522725248:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518248.220975:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789518248.221141:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518248.221168:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7405cc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789518248.221177:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522725120:0@lo:39:umount.0 00000100:00080000:2.0:1789518248.221824:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518248.221829:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789518248.221833:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789518248.222977:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.222992:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223030:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223037:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223057:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518248.223063:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223070:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223075:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223081:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223094:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789518248.223100:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223106:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223112:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223128:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223142:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789518248.223147:0:15100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223153:0:15100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223159:0:15100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223165:0:15100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518248.223171:0:15100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789518248.223174:0:15100:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789518248.223202:0:15100:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789518248.223207:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789518248.223211:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518248.223216:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1789518248.223222:0:15100:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e73030ce000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518248.223227:0:15100:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e73020d1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518248.223231:0:15100:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e743b240800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518248.223235:0:15100:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e743b39e800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789518248.223240:0:15100:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8e7404828000) has exports, disconnecting them 00000020:00080000:2.0:1789518248.223249:0:15100:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e73030ce000), last request at 1789518246 00000020:00000080:2.0:1789518248.223256:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314101 00000100:00080000:2.0:1789518248.223275:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e73030cd800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789518248.223326:0:15100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e73030ce000): rc 0 00000020:00000080:2.0:1789518248.223329:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e73030ce000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789518248.223337:0:15100:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e73020d1800), last request at 1789518246 00000020:00000080:2.0:1789518248.223340:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231400c 00000100:00080000:2.0:1789518248.223344:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e73020d4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789518248.223360:0:15100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e73020d1800): rc 0 00000020:00000080:2.0:1789518248.223362:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e73020d1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789518248.223365:0:15100:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e743b240800), last request at 1789518006 00000020:00000080:2.0:1789518248.223367:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313ed8 00000100:00080000:2.0:1789518248.223371:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e743b243800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789518248.223376:0:15100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e743b240800): rc 0 00000020:00000080:2.0:1789518248.223378:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e743b240800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789518248.223382:0:15100:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e743b39e800), last request at 1789518006 00000020:00000080:2.0:1789518248.223385:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e99 00000100:00080000:2.0:1789518248.223388:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e743a56a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518248.223393:0:15100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1789518248.223505:0:15100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e743b39e800): rc 0 00000004:00000080:2.0:1789518248.223511:0:15100:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9964159bae0 00000100:00080000:2.0:1789518248.223531:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789518248.223535:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1789518248.223853:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522725248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518248.224028:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789518248.224037:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224047:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518248.224051:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224060:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518248.224067:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518248.224073:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518248.224075:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1789518248.224077:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789518248.224119:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224126:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518248.224159:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224168:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d400/0x8d0fd6794231429e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423142a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224192:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789518248.224195:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224201:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dcf000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518248.224204:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224211:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518248.224216:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518248.224221:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518248.224224:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789518248.224226:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789518248.224238:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224244:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518248.224250:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224262:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf000/0x8d0fd67942314194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd6794231419b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224272:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518248.224275:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224280:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ce00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518248.224283:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224289:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518248.224296:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518248.224300:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789518248.224302:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789518248.224304:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789518248.224317:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224324:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518248.224334:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224340:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9ce00/0x8d0fd679423144ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423144f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224376:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518248.224380:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224386:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030600 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518248.224388:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224394:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518248.224400:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518248.224405:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518248.224407:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789518248.224409:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789518248.224423:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224429:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518248.224434:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224440:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400030600/0x8d0fd67942313d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942313d57 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518248.224449:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518248.224451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518248.224458:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518248.224498:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522725376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518248.224563:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518248.224600:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518248.224763:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522725632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518248.224791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518248.224813:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518248.224818:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522725760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518248.224839:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518248.224869:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522725376 00000100:00100000:3.0:1789518248.224877:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522725376 00000100:00100000:3.0:1789518248.224927:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522725632 00000100:00100000:3.0:1789518248.224930:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522725632 00000100:00100000:3.0:1789518248.224944:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522725760 00000100:00100000:3.0:1789518248.224946:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522725760 00000100:00100000:3.0:1789518248.224959:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518248.224967:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+25:3639:x1876445522725376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518248.224979:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518248.224994:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dce200/0x8d0fd679423142a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd6794231429e expref: 25 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.225006:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518248.225049:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+24:3639:x1876445522725376:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518248.225066:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518248.225083:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518248.225089:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+23:3637:x1876445522725632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518248.225097:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518248.225105:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dce000/0x8d0fd679423144f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd679423144ea expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.225114:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518248.225140:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+22:3637:x1876445522725632:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518248.225146:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518248.225158:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518248.225163:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+21:3637:x1876445522725760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518248.225171:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518248.225178:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740166d000/0x8d0fd67942313d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942313d50 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518248.225187:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518248.225207:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3637:x1876445522725760:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518248.225212:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518248.225242:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522725760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518248.225250:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522725632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518248.225355:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522725504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518248.225378:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518248.225405:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522725376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518248.225422:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518248.225489:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518248.225499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73030ce000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789518248.225545:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73020d1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789518248.225569:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743b240800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789518248.225594:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73030cd800 for lustre-MDT0000 00000020:00000080:1.0:1789518248.225599:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73020d4800 for lustre-MDT0000 00000020:00000080:1.0:1789518248.225611:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e743b243800 for lustre-MDT0000 00000100:00100000:1.0:1789518248.225622:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522725504 00000100:00100000:1.0:1789518248.225626:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522725504 00000100:00100000:1.0:1789518248.225649:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518248.225655:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+20:3639:x1876445522725504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518248.225662:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518248.225669:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dce800/0x8d0fd6794231419b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314194 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518248.225678:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518248.225706:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3639:x1876445522725504:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518248.225712:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518248.227118:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522725504:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789518248.229550:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789518248.229588:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789518248.229803:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522725888:0@lo:39:umount.0 00000100:00100000:0.0:1789518248.229878:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518248.230206:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522725888 00000100:00100000:2.0:1789518248.230215:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522725888 00000100:00100000:2.0:1789518248.230266:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789518248.230287:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876445522725888:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789518248.230325:0:6519:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313f33 00000100:00080000:2.0:1789518248.230334:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8e7435dc5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518248.230367:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789518248.230545:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3636:x1876445522725888:12345-0@lo:39:umount.0 Request processed in 259us (666us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789518248.230552:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00010000:0.0:1789518248.230700:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518248.230734:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789518248.230741:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522725888:0@lo:39:umount.0 00000100:00080000:2.0:1789518248.230880:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789518248.230884:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789518248.230901:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789518248.230964:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789518248.230980:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e7301977800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789518248.231028:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522726016:0@lo:9:umount.0 00000100:00100000:1.0:1789518248.231067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789518248.231109:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789518248.231112:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1789518248.231128:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789518248.231186:0:15100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789518248.231195:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e73034e6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789518248.231426:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522726144:0@lo:9:umount.0 00000100:00100000:1.0:1789518248.231460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518248.231548:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726016 00000100:00100000:0.0:1789518248.231554:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726016 00000100:00100000:0.0:1789518248.231616:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789518248.231625:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876445522726016:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789518248.231644:0:8429:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231402f 00000100:00080000:0.0:1789518248.231652:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8e73020d7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518248.231690:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789518248.231779:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1876445522726016:12345-0@lo:9:umount.0 Request processed in 155us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518248.231788:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1789518248.231811:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518248.231939:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518248.232196:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7301977800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789518248.232215:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789518248.232217:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518248.232221:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522726016:0@lo:9:umount.0 00000020:00080000:2.0:1789518248.232337:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e7404828000) has no exports 00000100:00100000:0.0:1789518248.233243:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726144 00000100:00100000:0.0:1789518248.233264:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726144 00000100:00100000:1.0:1789518248.233514:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789518248.233526:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1876445522726144:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789518248.233556:0:13804:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423141c5 00000100:00080000:1.0:1789518248.233567:0:13804:0:(import.c:65:import_set_state_nolock()) ffff8e7435e30800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518248.233620:0:13804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789518248.233753:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3636:x1876445522726144:12345-0@lo:9:umount.0 Request processed in 229us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518248.233760:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:1.0:1789518248.233779:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518248.233806:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73034e6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789518248.233818:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789518248.233820:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518248.233823:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522726144:0@lo:9:umount.0 00000100:00080000:3.0:1789518248.234172:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1789518248.245043:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e7404828000) has no exports 00000020:00000080:2.0:1789518248.337692:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313dab 00000020:00000080:2.0:1789518248.337708:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7404488800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789518248.337781:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789518248.338085:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518248.338096:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518248.338101:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8e74317cb380) has no exports 00000020:00000080:3.0:1789518248.338413:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313da4 00000020:00000080:3.0:1789518248.338420:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74414cb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518248.347522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7404488800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789518248.353577:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518248.353597:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789518248.353603:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74414c8000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789518248.353608:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74414c8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789518248.353632:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789518248.353888:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74414cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789518249.013803:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789518249.976505:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518249.976518:0:9506:0:(genops.c:885:class_export_put()) final put ffff8e7435e37000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789518249.976617:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:2.0:1789518249.976622:0:9506:0:(genops.c:885:class_export_put()) final put ffff8e7303532800/5499dd84-083f-4a57-a16b-aad857025063 00000001:00100000:3.0:1789518249.977435:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789518249.977442:0:8421:0:(genops.c:885:class_export_put()) final put ffff8e73020d0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789518249.977496:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7435e37000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789518249.977562:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7435e30800 for lustre-OST0001 00000001:00100000:0.0:1789518249.978392:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789518249.978405:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789518249.978410:0:7444:0:(genops.c:885:class_export_put()) final put ffff8e7435dc4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789518249.978428:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:00080000:0.0:1789518249.978436:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789518249.978438:0:7444:0:(genops.c:885:class_export_put()) final put ffff8e743f8af000/b5627b1d-cf97-43a8-8382-f16e6ba3aeed 00000001:00100000:0.0:1789518249.978443:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000001:00080000:0.0:1789518249.978448:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789518249.978483:0:7444:0:(genops.c:885:class_export_put()) final put ffff8e730292e800/5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:1.0:1789518249.978590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7435dc4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789518249.978646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743f8af000/b5627b1d-cf97-43a8-8382-f16e6ba3aeed for lustre-MDT0001 00000020:00000080:1.0:1789518249.978669:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e730292e800/5499dd84-083f-4a57-a16b-aad857025063 for lustre-MDT0001 00000020:00000080:1.0:1789518249.978689:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7435dc5800 for lustre-MDT0001 00000020:00000080:1.0:1789518249.978694:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e743f8a8000 for lustre-MDT0001 00000020:00000080:1.0:1789518249.978697:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e743f88e800 for lustre-MDT0001 00000020:00000080:0.0:1789518249.979443:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7303532800/5499dd84-083f-4a57-a16b-aad857025063 for lustre-OST0001 00000020:00000080:0.0:1789518249.979534:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7423638800 for lustre-OST0001 00000001:00100000:3.0:1789518249.980025:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:3.0:1789518249.980038:0:8421:0:(genops.c:885:class_export_put()) final put ffff8e74039e3000/5499dd84-083f-4a57-a16b-aad857025063 00000020:00000080:2.0:1789518249.980126:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73020d0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789518249.980165:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74039e3000/5499dd84-083f-4a57-a16b-aad857025063 for lustre-OST0000 00000020:00000080:2.0:1789518249.980198:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73020d7000 for lustre-OST0000 00000020:00000080:2.0:1789518249.980202:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e74039e2800 for lustre-OST0000 00010000:00010000:0.0:1789518250.038430:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518250.485737:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522726272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518250.485822:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518250.486010:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726272 00000100:00100000:2.0:1789518250.486019:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726272 00000100:00100000:2.0:1789518250.486099:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789518250.486109:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522726272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518250.486140:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789518250.486198:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522726272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518250.486206:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789518250.486295:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522726272:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789518250.486446:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518251.061851:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518252.022449:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522726784:0@lo:400:kworker.0 00000100:00100000:2.0:1789518252.022531:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522726656:0@lo:400:kworker.0 00000100:00100000:2.0:1789518252.022622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518252.022704:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522727168:0@lo:400:kworker.0 00000100:00100000:2.0:1789518252.022727:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518252.022755:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789518252.022761:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522726528:0@lo:400:kworker.0 00000100:00100000:2.0:1789518252.022787:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518252.022808:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522727040:0@lo:400:kworker.0 00000100:00100000:2.0:1789518252.022831:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518252.022882:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726528 00000100:00100000:2.0:1789518252.022892:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726528 00000100:00100000:2.0:1789518252.022940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789518252.022949:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876445522726528:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789518252.022959:0:6518:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789518252.023004:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876445522726528:12345-0@lo:400:kworker.0 Request processed in 54us (215us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789518252.023012:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789518252.023058:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727040 00000100:00100000:2.0:1789518252.023062:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727040 00000100:00100000:2.0:1789518252.023118:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789518252.023126:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522727040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518252.023330:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522727040:12345-0@lo:400:kworker.0 Request processed in 204us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518252.023338:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1789518252.023384:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789518252.023390:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789518252.023394:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789518252.023563:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726656 00000100:00100000:0.0:1789518252.023568:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726656 00000100:00100000:0.0:1789518252.023598:0:8781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727168 00000100:00100000:0.0:1789518252.023601:0:8781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727168 00000100:00100000:0.0:1789518252.023620:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789518252.023626:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876445522726656:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789518252.023643:0:8781:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789518252.023678:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876445522726656:12345-0@lo:400:kworker.0 Request processed in 52us (1057us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789518252.023685:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789518252.023711:0:8781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789518252.023716:0:8781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876445522727168:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789518252.023721:0:8781:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789518252.023746:0:8781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876445522727168:12345-0@lo:400:kworker.0 Request processed in 29us (1018us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789518252.023751:0:8781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1789518252.023809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518252.023993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.024031:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522727296:0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.024054:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.024075:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789518252.024080:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522726400:0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.024112:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.024137:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522726912:0@lo:400:kworker.0 00000100:00100000:1.0:1789518252.024200:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726400 00000100:00100000:1.0:1789518252.024206:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726400 00000100:00100000:1.0:1789518252.024245:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789518252.024253:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3639:x1876445522726400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518252.024488:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726784 00000100:00100000:0.0:1789518252.024494:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726784 00000100:00100000:0.0:1789518252.024515:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727296 00000100:00100000:0.0:1789518252.024518:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727296 00000100:00100000:0.0:1789518252.024543:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789518252.024549:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522727296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518252.034267:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74316f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfb1fc7-85a9-4c59-b070-db791c081ea7+19:3639:x1876445522726400:12345-0@lo:400:kworker.0 Request processed in 8860us (8999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518252.034289:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789518252.034568:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789518252.034579:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1876445522726784:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789518252.034733:0:14668:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789518252.034822:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1876445522726784:12345-0@lo:400:kworker.0 Request processed in 243us (10829us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789518252.034830:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789518252.034878:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518252.037347:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518252.037363:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 174 00000100:00080000:2.0:1789518252.037387:0:3638:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e74316b8800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518252.037497:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033d8380 x1876445522727552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518252.037536:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522726528:0@lo:400:kworker.0 00000100:00100000:2.0:1789518252.037556:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522727552:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789518252.037642:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518252.037709:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727552 00000100:00100000:2.0:1789518252.037719:0:10345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727552 00000100:00100000:2.0:1789518252.037767:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789518252.037775:0:10345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1876445522727552:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789518252.037798:0:10345:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789518252.039284:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522727296:12345-0@lo:400:kworker.0 Request processed in 14726us (15219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518252.039301:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789518252.040353:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522727040:0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.046209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.046292:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522727424:0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.046366:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.046435:0:9982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727424 00000100:00100000:3.0:1789518252.046446:0:9982:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727424 00000100:00100000:3.0:1789518252.046563:0:9982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789518252.046574:0:9982:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522727424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.046629:0:9982:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522727424:12345-0@lo:400:kworker.0 Request processed in 57us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518252.046636:0:9982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1789518252.046689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518252.046728:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522727424:0@lo:400:kworker.0 00000100:00080000:3.0:1789518252.046748:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789518252.046754:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789518252.046759:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789518252.046766:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518252.046771:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 195 00000100:00080000:3.0:1789518252.046783:0:3639:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e73020d3000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518252.046817:0:3639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f9b0700 x1876445522727680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518252.046845:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522726784:0@lo:400:kworker.0 00010000:00080000:3.0:1789518252.046876:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033db100 x1876445522727296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518252.046887:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522727296:0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.046916:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522726400:0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.046957:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522727680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789518252.047441:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.047524:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522726912 00000100:00100000:3.0:1789518252.047543:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522726912 00000100:00100000:3.0:1789518252.047590:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727680 00000100:00100000:3.0:1789518252.047593:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727680 00000100:00100000:3.0:1789518252.047609:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789518252.047617:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522726912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.047665:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522726912:12345-0@lo:400:kworker.0 Request processed in 50us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518252.047672:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789518252.047687:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789518252.047691:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876445522727680:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1789518252.047711:0:14668:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789518252.047745:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876445522727680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 52us (306us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518252.047751:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1789518252.047781:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518252.047786:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518252.047790:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522727680:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789518252.047807:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789518252.047830:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e90700 x1876445522726912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518252.047842:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522726912:0@lo:400:kworker.0 00000100:00080000:0.0:1789518252.052759:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789518252.052771:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8e743a54d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789518252.052776:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789518252.052783:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8e743a54d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518252.052789:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 174 00000100:00080000:0.0:1789518252.052807:0:3638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e743a54d800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518252.052875:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d0380 x1876445522727808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518252.052913:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522726656:0@lo:400:kworker.0 00000100:00080000:0.0:1789518252.052955:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789518252.052958:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789518252.052961:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789518252.052964:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518252.052967:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 221 00000100:00080000:0.0:1789518252.052972:0:3638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e7437796800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518252.052997:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d3480 x1876445522727936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518252.053007:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522727168:0@lo:400:kworker.0 00000100:00100000:3.0:1789518252.053502:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522727808:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789518252.053592:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.053638:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522727936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789518252.053662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518252.053719:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727808 00000100:00100000:3.0:1789518252.053727:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727808 00000100:00100000:3.0:1789518252.053766:0:14668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522727936 00000100:00100000:3.0:1789518252.053769:0:14668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522727936 00000100:00100000:3.0:1789518252.053791:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789518252.053799:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876445522727808:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789518252.053820:0:14668:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789518252.053886:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876445522727808:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 86us (294us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518252.053893:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789518252.053912:0:14668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789518252.053916:0:14668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876445522727936:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789518252.053923:0:14668:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789518252.053946:0:14668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1876445522727936:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 28us (284us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518252.053952:0:14668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1789518252.054591:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e743a54d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518252.054599:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518252.054603:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522727808:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1789518252.054618:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518252.054621:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518252.054624:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522727936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789518252.055412:0:10345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1876445522727552:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 17632us (17766us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789518252.055444:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1789518252.055590:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518252.055596:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518252.055599:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522727552:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1789518252.085835:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518252.343164:0:13796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789518252.533755:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518252.533780:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522728064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518252.533861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518252.534036:0:12153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522728064 00000100:00100000:2.0:1789518252.534055:0:12153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522728064 00000100:00100000:2.0:1789518252.534106:0:12153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789518252.534115:0:12153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522728064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518252.534148:0:12153:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789518252.534197:0:12153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522728064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518252.534202:0:12153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789518252.534400:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522728064:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789518253.110419:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789518254.071993:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789518254.072007:0:6490:0:(genops.c:885:class_export_put()) final put ffff8e743b39e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789518254.072418:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743b39e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789518254.073160:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e743a56a000 for lustre-MDT0000 00010000:00010000:1.0:1789518254.139554:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789518254.389894:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e7303005360 - data ffff8e740e155af8/ffff8e7435eb3c00 00000020:01000000:2.0:1789518254.390142:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e743156d480 - data ffff8e740e0f85e8/ffff8e744169a400 00000001:00000004:2.0:1789518254.399835:0:15100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789518254.491679:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789518254.491715:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789518254.491735:0:15100:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e7435e92a00 x1876445522725888/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789518258 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518254.491768:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789518254.499947:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789518254.499970:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1789518254.500002:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518254.500005:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789518254.500860:0:8444:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789518254.500870:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789518254.500886:0:8444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789518254.502539:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789518254.502551:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789518254.502572:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518254.502574:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789518254.503800:0:9980:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789518254.503811:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789518254.503847:0:9980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789518254.507590:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d73 00000020:00000080:3.0:1789518254.507618:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74044c8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518254.508867:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74044c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518254.514525:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d88 00000020:00000080:3.0:1789518254.514549:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74044ca000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789518254.514564:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789518254.514572:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518254.514586:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518254.514593:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8e740482cd40) has no exports 00000020:00000080:0.0:1789518254.514739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74044ca000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1789518254.515171:0:15100:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789518254.515185:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423141be 00000020:00000080:3.0:1789518254.515192:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7303533800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789518254.515245:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789518254.515253:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518254.515267:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789518254.515271:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8e73034fcd40) has no exports 00000020:00000080:3.0:1789518254.515281:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423141b7 00000020:00000080:3.0:1789518254.515286:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e73034e2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518254.517024:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7303533800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789518254.518044:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73034e2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789518254.519163:0:15100:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789518254.519173:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789518254.519194:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789518254.519206:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518254.519210:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518254.519284:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518254.519313:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518254.519325:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313fbf 00000020:00000080:3.0:1789518254.519345:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7301970800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789518254.519353:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789518254.519359:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518254.519366:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789518254.519370:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8e74217ecd40) has no exports 00000020:00000080:3.0:1789518254.519381:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313f9c 00000020:00000080:3.0:1789518254.519386:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7301975800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789518254.520200:0:15100:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789518254.520208:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789518254.520213:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789518254.520218:0:15100:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518254.520220:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518254.520250:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518254.520258:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789518254.520278:0:15100:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789518254.520287:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313f2c 00000020:00000080:3.0:1789518254.520314:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74416ea800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789518254.520320:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789518254.520326:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518254.520454:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789518254.520459:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e743a570000) has no exports 00000020:00000080:3.0:1789518254.520723:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313f25 00000020:00000080:3.0:1789518254.520730:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74316bd000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518254.521616:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73034e6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789518254.521636:0:36:0:(genops.c:885:class_export_put()) final put ffff8e73034e2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518254.521641:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73034e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789518254.521655:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518254.521779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7301970800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789518254.521787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7301975800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518254.521792:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7301977800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789518254.521798:0:36:0:(genops.c:885:class_export_put()) final put ffff8e7301976800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518254.521800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7301976800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789518254.521804:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518254.521847:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74416ea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789518254.521853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74316bd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789518254.557690:0:15100:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789518254.557704:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789518254.557710:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789518254.557724:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518254.557853:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518254.557873:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518254.557907:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518254.557911:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518254.557918:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74044c9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518254.557925:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74044c9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789518254.557938:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518254.558111:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e74316b8000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789518254.558123:0:36:0:(genops.c:885:class_export_put()) final put ffff8e743a56c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789518254.558125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a56c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789518254.558135:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518254.558592:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d8f 00000020:00000080:0.0:1789518254.558603:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74044cc000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789518254.558644:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789518254.558650:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518254.558658:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518254.558663:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8e74048299c0) has no exports 00000020:00000080:0.0:1789518254.558694:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518254.558699:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789518254.558706:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d96 00000020:00000080:0.0:1789518254.558711:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74044cb000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789518254.558721:0:15100:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7439644800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789518254.558725:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7439644800 3 00000020:01000004:0.0:1789518254.558728:0:15100:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e7439644800 from lustre-MDT0000 00000020:00000080:0.0:1789518254.558749:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518254.558753:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789518254.558756:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e74044cf000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789518254.558759:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74044cf000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789518254.558768:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789518254.558802:0:15100:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789518254.558807:0:15100:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789518254.558811:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789518254.558826:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518254.558830:0:15100:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1789518254.559078:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74044cc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789518254.559085:0:36:0:(genops.c:885:class_export_put()) final put ffff8e74044ca800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789518254.559087:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74044ca800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789518254.559093:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789518254.559147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74044cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1789518254.559187:0:15100:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8e7409e31000 ecfb1fc7-85a9-4c59-b070-db791c081ea7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789518254.559195:0:15100:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8e740dd9b380) has exports, disconnecting them 00000020:00080000:0.0:1789518254.559201:0:15100:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e7409e31000), last request at 1789517985 00000020:00000080:0.0:1789518254.559221:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d34 00000020:00010000:0.0:1789518254.559227:0:15100:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e7409e31000: total 0 00000100:00080000:0.0:1789518254.559233:0:15100:0:(import.c:65:import_set_state_nolock()) ffff8e7409e37000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789518254.559261:0:15100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7409e31000): rc 0 00000020:00080000:0.0:1789518254.559265:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8e740dd9b380) has no exports 00000020:00010000:1.0:1789518254.559356:0:6501:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e7409e31000: total 0 00010000:00010000:1.0:1789518254.559384:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e7409e31000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789518254.559421:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030e00/0x8d0fd679423142b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd679423142ac expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559442:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9c000/0x8d0fd67942314155 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd6794231414e expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559498:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740166de00/0x8d0fd679423144e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd679423144dc expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559513:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435dcfe00/0x8d0fd6794231426d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314266 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559523:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030000/0x8d0fd6794231423c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314235 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559532:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9c800/0x8d0fd6794231427b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314274 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559543:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9de00/0x8d0fd6794231425f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314258 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559571:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400031400/0x8d0fd67942313e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942313e37 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559585:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e740166c400/0x8d0fd679423144c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd679423144c0 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559596:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423144d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd679423144ce expref: 5 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559619:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400031a00/0x8d0fd67942313e30 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942313e29 expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559646:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030c00/0x8d0fd6794231424a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314243 expref: 3 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559658:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0de00/0x8d0fd67942314289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8d0fd67942314282 expref: 2 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518254.559670:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e7409e31000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789518254.559688:0:6501:0:(genops.c:885:class_export_put()) final put ffff8e7409e31000/ecfb1fc7-85a9-4c59-b070-db791c081ea7 00010000:00010000:1.0:1789518254.559702:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518254.559705:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518254.559707:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518254.559755:0:6507:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e7413819600:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1789518254.559910:0:6506:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e7413817e00:6506] 1 exiting: rc = 0 00000100:00100000:1.0:1789518254.560248:0:6505:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e7410f17800:6505] 0 exiting: rc = 1 00000020:00000080:0.0:1789518254.560509:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7409e31000/ecfb1fc7-85a9-4c59-b070-db791c081ea7 for MGS 00000020:00000080:0.0:1789518254.560557:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7409e37000 for MGS 00000100:00100000:0.0:1789518254.560623:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560659:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560667:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560674:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560680:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560685:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560692:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560702:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560709:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560715:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560723:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560728:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560735:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560742:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560750:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560756:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560764:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560771:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560777:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560785:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560792:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560798:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560804:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.560811:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561108:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561120:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561127:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561135:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561142:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561150:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561157:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561163:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561171:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561178:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561185:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561191:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561205:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561211:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561217:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561223:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561229:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561235:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561241:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561246:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561252:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561257:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561263:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561270:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561276:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561281:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561286:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561301:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561307:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561312:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561318:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561324:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561330:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561390:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561397:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561403:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561409:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561415:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561421:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518254.561428:0:15100:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789518254.564673:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e74062db240 - data ffff8e740e322000/ffff8e743b421c00 00000020:01000000:1.0:1789518254.565083:0:15100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e7403f91960 - data ffff8e740e0191b0/ffff8e7409eab400 00000020:00000080:1.0:1789518254.567144:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d18 00000020:00000080:1.0:1789518254.567167:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7407990800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789518254.567248:0:15100:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7439644800 from MGS, refs=2 00000020:01000004:1.0:1789518254.567253:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7439644800 2 00000020:01000004:1.0:1789518254.567257:0:15100:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e7439644800 from MGS 00000020:00000080:1.0:1789518254.567331:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518254.567351:0:15100:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789518254.567355:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7407992800/MGS 00000020:00000080:1.0:1789518254.567358:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7407992800/MGS for MGS 00000020:01000000:1.0:1789518254.567371:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789518254.567498:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789518254.567515:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518254.567523:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789518254.567531:0:15100:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e740448f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518254.567539:0:15100:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8e740dd98000) has exports, disconnecting them 00000020:00080000:1.0:1789518254.567545:0:15100:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e740448f000), last request at 1789517986 00000020:00000080:1.0:1789518254.567551:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313de3 00000020:00080000:1.0:1789518254.567565:0:15100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e740448f000): rc 0 00000020:00000080:1.0:1789518254.567571:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e740448f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789518254.575111:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7407990800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518254.578333:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e740448f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789518254.578786:0:15100:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789518254.578794:0:15100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518254.578800:0:15100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518254.578809:0:15100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518254.578876:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7405cc9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789518254.579314:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518254.579327:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789518254.579343:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e740448f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789518254.579349:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff8e740448f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789518254.579362:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789518254.579492:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7439644800 1 00000020:00000080:0.0:1789518254.579500:0:15100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d0a 00000020:00000080:0.0:1789518254.579508:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7407990000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789518254.579521:0:15100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789518254.579531:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7407990000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518254.579544:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518254.579550:0:15100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518254.579555:0:15100:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8e74217e99c0) has no exports 00000020:00000080:0.0:1789518254.621603:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518254.621769:0:15100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789518254.621777:0:15100:0:(genops.c:885:class_export_put()) final put ffff8e7439643800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518254.621783:0:15100:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7439643800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789518254.621790:0:15100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789518254.622122:0:15100:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e7439643000 00000020:02000400:0.0:1789518254.622228:0:15100:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789518255.157699:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518255.615274:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522728192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518255.615362:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518255.615776:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522728192 00000100:00100000:0.0:1789518255.615789:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522728192 00000100:00100000:0.0:1789518255.616160:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789518255.616173:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522728192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789518255.616204:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789518255.616260:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522728192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518255.616267:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1789518255.616388:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518255.616445:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522728192:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789518256.187702:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518257.143599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518257.143606:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789518257.143610:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518257.143618:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1789518257.143624:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789518257.143636:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e74316b8800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518257.143662:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033e4e00 x1876445522728448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518257.143677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518257.143681:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789518257.143683:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e743a54d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518257.143686:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1789518257.143689:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789518257.143707:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e743a54d800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518257.143727:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f938e00 x1876445522728576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518257.143736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518257.143739:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789518257.143741:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518257.143744:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1789518257.143747:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789518257.143751:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e73020d3000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518257.143762:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f939f80 x1876445522728704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518257.143791:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518257.143795:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789518257.143797:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518257.143800:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1789518257.143803:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789518257.143808:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e7437796800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518257.143818:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f939180 x1876445522729088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518257.143974:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522728320:0@lo:400:kworker.0 00000400:00000100:3.0:1789518257.144028:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445522728320 offset 0 length 224: 4 00000100:00100000:3.0:1789518257.144090:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522729344:0@lo:400:kworker.0 00000100:00100000:3.0:1789518257.144124:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144153:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518257.144159:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522728832:0@lo:400:kworker.0 00000100:00100000:3.0:1789518257.144182:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144222:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522728448:0@lo:38:kworker.0 00000100:00100000:3.0:1789518257.144248:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144280:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522728576:0@lo:38:kworker.0 00000100:00100000:3.0:1789518257.144301:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144318:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522728704:0@lo:38:kworker.0 00000100:00100000:3.0:1789518257.144338:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144352:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522729088:0@lo:38:kworker.0 00000100:00100000:3.0:1789518257.144371:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144400:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522728960:0@lo:400:kworker.0 00000100:00100000:3.0:1789518257.144422:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144441:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518257.144446:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522729216:0@lo:400:kworker.0 00000100:00100000:3.0:1789518257.144503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518257.144533:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729344 00000100:00100000:3.0:1789518257.144542:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729344 00000100:00100000:3.0:1789518257.144596:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522728960 00000100:00100000:3.0:1789518257.144600:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522728960 00000100:00100000:3.0:1789518257.144624:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789518257.144632:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522729344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518257.144684:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522729344:12345-0@lo:400:kworker.0 Request processed in 53us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518257.144701:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789518257.144718:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789518257.144725:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522728960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518257.144759:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522728960:12345-0@lo:400:kworker.0 Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518257.144765:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789518257.144784:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522728448 00000100:00100000:3.0:1789518257.144788:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522728448 00000100:00100000:3.0:1789518257.144808:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789518257.144813:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1876445522728448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789518257.144832:0:6519:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789518257.147315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522728832 00000100:00100000:1.0:1789518257.147330:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522728832 00000100:00100000:1.0:1789518257.147380:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522728576 00000100:00100000:1.0:1789518257.147384:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522728576 00000100:00100000:1.0:1789518257.147395:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522728704 00000100:00100000:1.0:1789518257.147398:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522728704 00000100:00100000:1.0:1789518257.147406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729088 00000100:00100000:1.0:1789518257.147422:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729088 00000100:00100000:1.0:1789518257.147433:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729216 00000100:00100000:1.0:1789518257.147436:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729216 00000100:00100000:1.0:1789518257.147458:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789518257.147487:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522728832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518257.147567:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522728832:12345-0@lo:400:kworker.0 Request processed in 83us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518257.147574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789518257.147589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789518257.147595:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522729216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518257.147622:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522729216:12345-0@lo:400:kworker.0 Request processed in 27us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518257.147627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789518257.147638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789518257.147643:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522728576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789518257.147660:0:6514:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789518257.147699:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522728576:12345-0@lo:38:kworker.0 Request processed in 54us (3397us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789518257.147705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789518257.147716:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789518257.147720:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522728704:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789518257.147729:0:6514:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789518257.147751:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522728704:12345-0@lo:38:kworker.0 Request processed in 30us (3413us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789518257.147756:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789518257.147766:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789518257.147778:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522729088:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789518257.147788:0:6514:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789518257.147814:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522729088:12345-0@lo:38:kworker.0 Request processed in 36us (3442us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789518257.147819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1789518257.152393:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518257.152403:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518257.152406:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789518257.152520:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e743f93a300 x1876445522728832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518257.152538:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522728832:0@lo:400:kworker.0 00000100:00100000:2.0:1789518257.152553:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522729344:0@lo:400:kworker.0 00010000:00080000:2.0:1789518257.152598:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e743f938380 x1876445522729216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518257.152608:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522729216:0@lo:400:kworker.0 00000100:00100000:2.0:1789518257.152618:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522728960:0@lo:400:kworker.0 00000100:00080000:2.0:1789518257.152649:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e743a54d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518257.152681:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789518257.152685:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522728576:0@lo:38:kworker.0 00000100:00080000:2.0:1789518257.152698:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518257.152702:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789518257.152705:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522728704:0@lo:38:kworker.0 00000100:00080000:2.0:1789518257.152713:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518257.152716:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789518257.152719:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522729088:0@lo:38:kworker.0 00000100:00100000:3.0:1789518257.167913:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1876445522728448:12345-0@lo:38:kworker.0 Request processed in 23090us (23655us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518257.167930:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:1.0:1789518257.168993:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518257.169004:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789518257.169009:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522728448:0@lo:38:kworker.0 00010000:00010000:1.0:1789518257.207408:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518257.659518:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522729472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789518257.659607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518257.659679:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729472 00000100:00100000:1.0:1789518257.659690:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729472 00000100:00100000:1.0:1789518257.659759:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789518257.659770:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522729472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518257.659802:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789518257.659862:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522729472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518257.659870:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789518257.659951:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522729472:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789518258.230651:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789518258.389011:0:15302:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789518258.427905:0:15302:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789518258.427993:0:15302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.428009:0:15302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.428016:0:15302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.428025:0:15302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.428071:0:15302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789518258.428077:0:15302:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789518258.428120:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1789518258.428396:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518258.428404:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518258.428414:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030a00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518258.428418:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518258.428427:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518258.428435:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518258.428441:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518258.428444:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789518258.428446:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789518258.428522:0:7454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518258.428530:0:7454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518258.428567:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518258.428575:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd67942314274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd6794231427b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518258.428588:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518258.428590:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518258.428592:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518258.428609:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518258.428627:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522729600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518258.428707:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518258.429050:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729600 00000100:00100000:0.0:1789518258.429057:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729600 00000100:00100000:0.0:1789518258.429099:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518258.429117:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1876445522729600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789518258.429124:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518258 with bad export cookie 10164578700288408884 00000100:00100000:1.0:1789518258.429879:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789518258.429889:0:15302:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789518258.429896:0:15302:0:(import.c:65:import_set_state_nolock()) ffff8e743a54d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789518258.429902:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518258.429904:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789518258.429907:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789518258.434486:0:15302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434510:0:15302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434517:0:15302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434524:0:15302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434547:0:15302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518258.434553:0:15302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434560:0:15302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434587:0:15302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434593:0:15302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434611:0:15302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789518258.434618:0:15302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434625:0:15302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434631:0:15302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434637:0:15302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434654:0:15302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789518258.434660:0:15302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434665:0:15302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434670:0:15302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434686:0:15302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518258.434694:0:15302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1789518258.434698:0:15302:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789518258.434731:0:15302:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789518258.434736:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789518258.434741:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518258.434747:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789518258.434755:0:15302:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8e7302929800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518258.434760:0:15302:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8e7435e31000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518258.434765:0:15302:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8e743a573380) has exports, disconnecting them 00000020:00080000:1.0:1789518258.434770:0:15302:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e7302929800), last request at 1789518257 00000020:00000080:1.0:1789518258.434779:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314116 00000100:00080000:1.0:1789518258.434813:0:15302:0:(import.c:65:import_set_state_nolock()) ffff8e730292e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789518258.434948:0:15302:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7302929800): rc 0 00000020:00000080:1.0:1789518258.434951:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e7302929800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789518258.434962:0:15302:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e7435e31000), last request at 1789518257 00000020:00000080:1.0:1789518258.434965:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314021 00000100:00080000:1.0:1789518258.434971:0:15302:0:(import.c:65:import_set_state_nolock()) ffff8e7435e30000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789518258.434982:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7302929800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789518258.435028:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e730292e000 for lustre-MDT0001 00000020:00080000:1.0:1789518258.435044:0:15302:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7435e31000): rc 0 00000020:00000080:1.0:1789518258.435046:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e7435e31000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789518258.435056:0:15302:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb99641ecfae0 00000020:00000080:1.0:1789518258.435066:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7435e31000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789518258.435093:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7435e30000 for lustre-MDT0001 00000100:00080000:1.0:1789518258.435123:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518258.435127:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1789518258.435955:0:15302:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789518258.435962:0:15302:0:(import.c:65:import_set_state_nolock()) ffff8e74316b8800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789518258.436304:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789518258.436313:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436324:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d800 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518258.436329:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436340:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518258.436347:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518258.436352:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518258.436355:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1789518258.436358:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1789518258.436403:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436425:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518258.436460:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436505:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d800/0x8d0fd67942314282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314289 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436534:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789518258.436538:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436544:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166c000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518258.436547:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436555:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518258.436562:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518258.436567:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518258.436569:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789518258.436571:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789518258.436584:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436590:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518258.436608:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436626:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740166c000/0x8d0fd6794231414e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942314155 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436640:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518258.436644:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436649:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166ca00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518258.436653:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436660:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518258.436666:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518258.436672:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789518258.436674:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789518258.436676:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789518258.436690:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436697:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518258.436703:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436709:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740166ca00/0x8d0fd679423144dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd679423144e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436728:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518258.436733:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436738:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3c00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:2.0:1789518258.436741:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436747:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518258.436753:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518258.436758:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518258.436760:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789518258.436761:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789518258.436774:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436779:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518258.436786:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436792:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942313e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8d0fd67942313e3e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518258.436805:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518258.436807:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518258.436814:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518258.436909:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522730112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518258.436975:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518258.437032:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518258.437039:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522729728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518258.437062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518258.437089:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522729856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518258.437126:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518258.437144:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518258.437149:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522729984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518258.437168:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518258.437195:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522730112 00000100:00100000:2.0:1789518258.437202:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522730112 00000100:00100000:2.0:1789518258.437229:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729728 00000100:00100000:2.0:1789518258.437233:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729728 00000100:00100000:2.0:1789518258.437242:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729856 00000100:00100000:2.0:1789518258.437244:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729856 00000100:00100000:2.0:1789518258.437251:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522729984 00000100:00100000:2.0:1789518258.437264:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522729984 00000100:00100000:2.0:1789518258.437277:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518258.437285:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1876445522730112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789518258.437291:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518258 with bad export cookie 10164578700288408884 00000100:00100000:2.0:1789518258.437334:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1876445522730112:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (358us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789518258.437341:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518258.437357:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518258.437361:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7405e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1876445522729728:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789518258.437365:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518258 with bad export cookie 10164578700288408884 00000100:00100000:2.0:1789518258.437397:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7405e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1876445522729728:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (334us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789518258.437403:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518258.437415:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518258.437419:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1876445522729856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789518258.437422:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518258 with bad export cookie 10164578700288408884 00000100:00100000:2.0:1789518258.437449:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1876445522729856:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (322us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789518258.437455:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518258.437485:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518258.437489:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1876445522729984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789518258.437493:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518258 with bad export cookie 10164578700288408884 00000100:00100000:2.0:1789518258.437512:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1876445522729984:12345-0@lo:103:ldlm_bl.0 Request processed in 22us (343us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789518258.437517:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789518258.437548:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789518258.437552:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8e7409e34800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789518258.437556:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1789518258.442228:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518258.442894:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789518258.442900:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:1.0:1789518258.442935:0:15302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789518258.442995:0:15302:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789518258.443021:0:15302:0:(import.c:65:import_set_state_nolock()) ffff8e73021fa800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789518258.443043:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789518258.443045:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1789518258.443060:0:15302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518258.443146:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522730240:0@lo:9:umount.0 00000100:00100000:1.0:1789518258.443226:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518258.443562:0:15302:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789518258.443575:0:15302:0:(import.c:65:import_set_state_nolock()) ffff8e7303456800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789518258.443595:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522730368:0@lo:9:umount.0 00000100:00100000:1.0:1789518258.443620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789518258.443662:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e743a573380) has no exports 00010000:00010000:3.0:1789518258.445769:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518258.445798:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522730240 00000100:00100000:3.0:1789518258.445811:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522730240 00000100:00100000:3.0:1789518258.445886:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522730368 00000100:00100000:3.0:1789518258.445890:0:13804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522730368 00000100:00100000:3.0:1789518258.445933:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789518258.445945:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1876445522730240:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789518258.445979:0:13804:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314075 00000100:00080000:3.0:1789518258.446003:0:13804:0:(import.c:65:import_set_state_nolock()) ffff8e73021fb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518258.446049:0:13804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789518258.446444:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3636:x1876445522730240:12345-0@lo:9:umount.0 Request processed in 306us (3023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518258.446453:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789518258.446495:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789518258.446503:0:13804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1876445522730368:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789518258.446515:0:13804:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231417f 00000100:00080000:3.0:1789518258.446520:0:13804:0:(import.c:65:import_set_state_nolock()) ffff8e73034e3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518258.446544:0:13804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789518258.446623:0:13804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3636:x1876445522730368:12345-0@lo:9:umount.0 Request processed in 122us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518258.446629:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:3.0:1789518258.446651:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518258.446684:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7303456800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789518258.446691:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789518258.446693:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518258.446697:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522730368:0@lo:9:umount.0 00000100:00080000:3.0:1789518258.446709:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73021fa800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789518258.446713:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789518258.446714:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518258.446717:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522730240:0@lo:9:umount.0 00010000:00010000:3.0:1789518258.446740:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518258.447883:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1789518258.449650:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1876445522729600:12345-0@lo:103:ldlm_bl.0 Request processed in 20523us (20934us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789518258.449666:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789518258.449732:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789518258.458061:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.143@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789518258.458067:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789518258.458077:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e741073b480 x1876445522728320/t0(0) o400->MGC192.168.202.143@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789518273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518258.458092:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d0380 x1876445522729600/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518274 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518258.458104:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e73033db800 x1876445522730112/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518274 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518258.458139:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e73033dbb80 x1876445522729728/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518274 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518258.458148:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e73033d8e00 x1876445522729856/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518274 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518258.458155:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e73033dad80 x1876445522729984/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518274 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789518258.458164:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789518258.458167:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789518258.458168:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789518258.461979:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e7409e34800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789518258.462049:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522730112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518258.462081:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3637:1876445522729728:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789518258.465494:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e7409e34800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789518258.465528:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3638:1876445522729600:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789518258.467801:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8e7409e34800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518258.467820:0:3639:0:(import.c:545:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 153 00000100:00080000:2.0:1789518258.467838:0:3639:0:(import.c:666:import_select_connection()) MGC192.168.202.143@tcp: import ffff8e7409e34800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518258.467885:0:3639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033d8380 x1876445522730496/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518258.467947:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522729856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518258.467958:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522728320:0@lo:400:kworker.0 00000100:00100000:2.0:1789518258.467983:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3639:1876445522729984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518258.468049:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522730496:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789518258.468097:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445522730496 offset 0 length 520: 4 00000020:00080000:3.0:1789518258.499035:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e743a573380) has no exports 00000020:01000000:2.0:1789518258.646454:0:15302:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e74062db480 - data ffff8e740e322ca8/ffff8e743b423400 00000020:01000000:2.0:1789518258.646686:0:15302:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e7410760060 - data ffff8e740e199288/ffff8e7435db6400 00000001:00000004:2.0:1789518258.657855:0:15302:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789518258.709025:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518258.709035:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789518258.709045:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789518258.710793:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789518258.710802:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:2.0:1789518258.710828:0:15302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518258.710831:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789518258.711060:0:8776:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789518258.711082:0:8776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1789518258.711092:0:8776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789518258.711725:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789518258.711735:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789518258.711751:0:15302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518258.711753:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789518258.712177:0:9976:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789518258.712181:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1789518258.712192:0:9976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789518258.717278:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e5a 00000020:00000080:2.0:1789518258.717294:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e743a568000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789518258.717772:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a568000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789518258.719867:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e6f 00000020:00000080:2.0:1789518258.719880:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e743a569800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789518258.719975:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789518258.719981:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518258.719989:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518258.719994:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8e740482b380) has no exports 00000004:01000000:2.0:1789518258.720160:0:15302:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789518258.720168:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314178 00000020:00000080:2.0:1789518258.720172:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e73034e6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789518258.721163:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a569800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789518258.721233:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789518258.721239:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518258.721258:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518258.721262:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8e73030eb380) has no exports 00000020:00000080:2.0:1789518258.721269:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314171 00000020:00000080:2.0:1789518258.721275:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e7303452800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789518258.721725:0:15302:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789518258.721730:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789518258.721734:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789518258.721739:0:15302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518258.721741:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518258.721772:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518258.721779:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789518258.721786:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231406e 00000020:00000080:2.0:1789518258.721791:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e73021ff800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789518258.721794:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789518258.721799:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518258.721802:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518258.721804:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8e743b254d40) has no exports 00000020:00000080:2.0:1789518258.721818:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314067 00000020:00000080:2.0:1789518258.721821:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e73021fd000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789518258.722016:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73034e6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789518258.722025:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7303452800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789518258.722030:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7303456800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789518258.722036:0:8:0:(genops.c:885:class_export_put()) final put ffff8e7437796000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789518258.722038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7437796000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789518258.722042:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789518258.722117:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73021ff800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789518258.722121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73021fd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789518258.722395:0:15302:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789518258.722399:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789518258.722402:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:2.0:1789518258.722406:0:15302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518258.722407:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518258.722509:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518258.722517:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789518258.722533:0:15302:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789518258.722540:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e92 00000020:00000080:2.0:1789518258.722547:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e743a568800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789518258.724522:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73021fa800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789518258.724542:0:8:0:(genops.c:885:class_export_put()) final put ffff8e73021fd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789518258.724546:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73021fd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789518258.724556:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789518258.724803:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789518258.724810:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518258.724821:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518258.724826:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8e743b250000) has no exports 00000020:00000080:2.0:1789518258.724836:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e8b 00000020:00000080:2.0:1789518258.724843:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e74316be800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789518258.725570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a568800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789518258.725578:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74316be800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789518258.726687:0:15302:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789518258.726694:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518258.726698:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1789518258.726706:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518258.726754:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518258.726764:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789518258.726801:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518258.726815:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789518258.726819:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e7441517800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789518258.726823:0:15302:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7441517800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789518258.726831:0:15302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789518258.727001:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e76 00000020:00000080:3.0:1789518258.727009:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e743a56f800/lustre-MDD0001_UUID 00000020:01000000:3.0:1789518258.727013:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789518258.727017:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518258.727022:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518258.727025:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8e743a574d40) has no exports 00000020:00000080:3.0:1789518258.727054:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518258.727058:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789518258.727062:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e7d 00000020:00000080:3.0:1789518258.727068:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e743a56d800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789518258.727076:0:15302:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e74044cd800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789518258.727079:0:15302:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e74044cd800 2 00000020:01000004:3.0:1789518258.727082:0:15302:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e74044cd800 from lustre-MDT0001 00000020:00000080:3.0:1789518258.727106:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518258.727110:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789518258.727113:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e743a56f000/lustre-MDT0001_UUID 00000020:00000080:3.0:1789518258.727115:0:15302:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a56f000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789518258.727121:0:15302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789518258.727151:0:15302:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789518258.727154:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789518258.727157:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518258.727161:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789518258.727168:0:15302:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8e743a54f800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789518258.727173:0:15302:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8e74217eb380) has exports, disconnecting them 00000020:00080000:3.0:1789518258.727177:0:15302:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8e743a54f800), last request at 1789518006 00000020:00000080:3.0:1789518258.727181:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313ed1 00000020:00080000:3.0:1789518258.727193:0:15302:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e743a54f800): rc 0 00000020:00000080:3.0:1789518258.727203:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e743a54f800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789518258.727881:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e74316b8800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789518258.727889:0:8:0:(genops.c:885:class_export_put()) final put ffff8e74316b9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789518258.727890:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74316b9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789518258.727895:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789518258.727993:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a56f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789518258.727997:0:8:0:(genops.c:885:class_export_put()) final put ffff8e743a56b000/lustre-MDD0001_UUID 00000020:00000080:0.0:1789518258.727998:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a56b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789518258.728000:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789518258.728135:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a56d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789518258.728148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a54f800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1789518258.749076:0:15302:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1789518258.749087:0:15302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518258.749092:0:15302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789518258.749100:0:15302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518258.749315:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518258.749324:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1789518258.749331:0:15302:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e74044cd800 1 00000020:00000080:3.0:1789518258.749339:0:15302:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313e0d 00000020:00000080:3.0:1789518258.749348:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e74416e0000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1789518258.749354:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1789518258.749363:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518258.749367:0:15302:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518258.749370:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8e740dd999c0) has no exports 00000020:00000080:0.0:1789518258.751825:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e743a54d800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789518258.751843:0:8:0:(genops.c:885:class_export_put()) final put ffff8e743a548800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789518258.751847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a548800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789518258.751859:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789518258.751948:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e74416e0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789518258.774234:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518258.774317:0:15302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789518258.774323:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e7405ccd800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789518258.774328:0:15302:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7405ccd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789518258.774334:0:15302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789518258.774532:0:15302:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e74044cf800 00000020:01000000:0.0:1789518258.774556:0:15302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789518258.774560:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518258.774565:0:15302:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518258.774569:0:15302:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8e74317c99c0) has no exports 00000100:00100000:2.0:1789518258.775077:0:6514:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8e7403ee3000:6514] 1 exiting: rc = 0 00000100:00100000:2.0:1789518258.775202:0:6515:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8e740dcce600:6515] 2 exiting: rc = 0 00000100:00100000:2.0:1789518258.775278:0:6513:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8e740dcce000:6513] 0 exiting: rc = 1 00000100:00100000:2.0:1789518258.775353:0:8781:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8e73020a4000:8781] 3 exiting: rc = 0 00000100:00100000:2.0:1789518258.775429:0:14668:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8e74095a4c00:14668] 4 exiting: rc = 0 00000100:00100000:0.0:1789518258.775611:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775622:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775628:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775634:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775640:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775645:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775649:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775655:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775660:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775665:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775670:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775676:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775680:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775685:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775690:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775717:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775738:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775744:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775749:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775754:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775760:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775765:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775771:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775776:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775781:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775786:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775791:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775796:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775801:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775806:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775811:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775816:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775821:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775826:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775831:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775836:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775842:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775847:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775852:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775857:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775862:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775868:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775873:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775878:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775884:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775889:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775893:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775898:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775904:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775909:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775914:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775940:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775945:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775951:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775956:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775961:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775967:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775973:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775978:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775983:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775988:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775993:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.775999:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.776012:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.778402:0:6516:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e74057d6800:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1789518258.779295:0:6517:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e74057d7400:6517] 1 exiting: rc = 0 00000100:00100000:0.0:1789518258.780223:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780234:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780240:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780246:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780263:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780269:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780274:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780280:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780286:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780292:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780297:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780303:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780310:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780315:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780320:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780325:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780330:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780335:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780343:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780348:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780353:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780370:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780375:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780381:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780387:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780392:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780398:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780402:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780407:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780412:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780417:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780422:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780427:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780432:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780437:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780441:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780446:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780451:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780457:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780573:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780580:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780585:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780590:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780596:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780600:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780605:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780609:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780615:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780619:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780624:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780629:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780634:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780640:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780645:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780650:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780655:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780668:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780673:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780678:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780683:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780690:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780694:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780699:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.780704:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518258.781279:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8e740dcc6e00:6518] 0 exiting: rc = 1 00000100:00100000:2.0:1789518258.781380:0:10345:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8e740ddbe200:10345] 2 exiting: rc = 0 00000100:00100000:3.0:1789518258.781596:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8e74057d7a00:6519] 1 exiting: rc = 0 00000100:00100000:0.0:1789518258.781893:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781901:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781909:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781915:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781931:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781939:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781952:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781958:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781964:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781970:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781976:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781981:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781986:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781992:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.781998:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782004:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782010:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782015:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782033:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782039:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782045:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782049:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782056:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782061:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782067:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782072:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782079:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782093:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782098:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782105:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782124:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782132:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782139:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782147:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782154:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782160:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782167:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782174:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782180:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782186:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782194:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782200:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782222:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782231:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782238:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782245:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782261:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782267:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782273:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782279:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782285:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782291:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782298:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782303:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782324:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782332:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782338:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782344:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782350:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782356:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782362:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782368:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782383:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.782397:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518258.789804:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e74057d6a00:6520] 0 exiting: rc = 1 00000100:00100000:2.0:1789518258.791087:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e740dcc6c00:6521] 1 exiting: rc = 0 00000100:00100000:0.0:1789518258.791287:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791297:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791303:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791308:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791314:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791321:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791327:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791332:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791337:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791342:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791347:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791352:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791357:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791362:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791367:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791371:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791376:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791380:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791387:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791392:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791397:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791402:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791407:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791411:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791416:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791421:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791426:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791431:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791436:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791441:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791445:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791450:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791455:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791567:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791573:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791578:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791583:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791588:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791593:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791597:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791602:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791606:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791611:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791615:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791620:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791625:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791630:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791634:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791638:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791642:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791648:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791652:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791657:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791662:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791667:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791672:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791677:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791682:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791686:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791691:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791696:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791700:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791704:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.791709:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518258.792374:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e7418808400:6523] 1 exiting: rc = 0 00000100:00100000:2.0:1789518258.792584:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e7431768c00:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1789518258.792697:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.792704:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.792709:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.792714:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.794967:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.794973:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.794978:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.794982:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.794988:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795005:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795013:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795018:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795023:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795028:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795033:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795038:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795043:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795048:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795052:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795057:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795062:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795066:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795071:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795076:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795081:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795086:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795091:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795107:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795113:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795119:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795124:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795130:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795135:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795140:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795146:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795151:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795156:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795162:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795167:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795182:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795187:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795193:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795200:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795205:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795210:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795215:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795219:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795226:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795231:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795235:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795240:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795245:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795260:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795267:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795272:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795277:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795282:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795287:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795293:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795298:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795302:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795308:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795313:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.795319:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796267:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e7418808000:6524] 0 exiting: rc = 1 00000100:00100000:2.0:1789518258.796411:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e7418808200:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1789518258.796511:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796517:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796522:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796526:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796532:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796537:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796543:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796548:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796553:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796567:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796573:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796578:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796582:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796586:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796591:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796596:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796601:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796605:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796610:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796615:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796620:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796624:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796628:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796632:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796637:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796642:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796646:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796651:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796655:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796660:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796664:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796669:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796673:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796678:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796689:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796695:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796701:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796706:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796711:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796961:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796969:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796974:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796980:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796985:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.796998:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797003:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797008:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797013:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797017:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797022:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797027:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797040:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797045:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797050:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797055:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797061:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797066:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797087:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797178:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797186:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797192:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797196:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797201:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797206:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.797872:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8e743176cc00:6528] 2 exiting: rc = 0 00000100:00100000:3.0:1789518258.797986:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8e743176ce00:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1789518258.798535:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8e740560ce00:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1789518258.798714:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798722:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798728:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798734:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798740:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798746:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798759:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798782:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798789:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798794:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798800:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798805:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798810:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798815:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798830:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798835:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798840:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798845:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798850:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798855:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798859:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798865:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798870:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798875:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798880:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798885:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798891:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798902:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798910:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798915:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798921:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798940:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798947:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798952:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798958:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798963:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798969:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798975:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798980:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798986:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798992:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.798997:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799017:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799186:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799193:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799198:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799204:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799210:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799215:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799228:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799234:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799240:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799245:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799259:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799265:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799290:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799299:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799305:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799325:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799352:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799357:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799362:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799369:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518258.799374:0:15302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789518258.805118:0:15302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518258.805131:0:15302:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789518258.805138:0:15302:0:(genops.c:885:class_export_put()) final put ffff8e7431797800/MDS_uuid 00000020:00000080:0.0:1789518258.805142:0:15302:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7431797800/MDS_uuid for MDS 00000020:01000000:0.0:1789518258.805147:0:15302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789518258.805306:0:15302:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789518259.259430:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518260.277657:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518261.301632:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518262.262016:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518262.262026:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518262.262029:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518262.262033:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789518262.262038:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518262.262047:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 424 00000100:00080000:0.0:1789518262.262053:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789518262.262065:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e73020d3000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518262.262116:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d1880 x1876445522730624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518262.262205:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522730624:0@lo:38:kworker.0 00000400:00000100:1.0:1789518262.262281:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522730624 offset 0 length 520: 4 00000100:00080000:0.0:1789518262.262401:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518262.262405:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789518262.262407:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518262.262412:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 424 00000100:00080000:0.0:1789518262.262415:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789518262.262422:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e7437796800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518262.262438:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d2a00 x1876445522730880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518262.262501:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522730752:0@lo:400:kworker.0 00000400:00000100:2.0:1789518262.262532:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522730752 offset 0 length 224: 4 00000100:00100000:1.0:1789518262.267060:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522730880:0@lo:38:kworker.0 00000400:00000100:1.0:1789518262.267131:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522730880 offset 0 length 520: 4 00000100:00100000:2.0:1789518262.267435:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522731008:0@lo:400:kworker.0 00000400:00000100:2.0:1789518262.267483:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522731008 offset 0 length 224: 4 00010000:00010000:0.0:1789518262.326325:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518262.657922:0:15502:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789518262.683846:0:15502:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789518262.683926:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518262.683944:0:15502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518262.683951:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518262.683959:0:15502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518262.683984:0:15502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518262.683989:0:15502:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789518262.684015:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518262.684026:0:15502:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d1880 x1876445522730624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789518282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518262.684045:0:15502:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789518262.684051:0:15502:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789518262.684066:0:15502:0:(import.c:65:import_set_state_nolock()) ffff8e73020d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789518262.684072:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518262.684075:0:15502:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d1880 x1876445522730624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789518282 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518262.684083:0:15502:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789518262.684102:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:1.0:1789518262.684170:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522730624:0@lo:38:kworker.0 00010000:00010000:3.0:1789518262.684433:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518262.684441:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518262.684448:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dce400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518262.684452:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518262.684489:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518262.684498:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518262.684512:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518262.684515:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518262.684517:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518262.684530:0:7454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:3.0:1789518262.684535:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518262.684541:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dce400/0x8d0fd67942314258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231425f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518262.684553:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518262.684555:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518262.684557:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518262.686278:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789518262.686295:0:15502:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d1180 x1876445522730752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518262.686402:0:15502:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789518262.686409:0:15502:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789518262.686436:0:15502:0:(import.c:65:import_set_state_nolock()) ffff8e740d7b2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789518262.686653:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522730752:0@lo:400:kworker.0 00000100:00100000:1.0:1789518262.688837:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1876445522731136:0@lo:39:umount.0 00000400:00000100:1.0:1789518262.689033:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522731136 offset 0 length 224: 4 00000100:00080000:3.0:1789518263.285777:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518263.285791:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518263.285794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518263.285798:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518263.285939:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522731264:0@lo:400:kworker.0 00000400:00000100:1.0:1789518263.285995:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522731264 offset 0 length 224: 4 00010000:00010000:3.0:1789518263.350132:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789518264.314746:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789518264.314755:0:8421:0:(genops.c:885:class_export_put()) final put ffff8e73021fb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789518264.315425:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73021fb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789518264.315483:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73021fb000 for lustre-OST0000 00000001:00100000:2.0:1789518264.315547:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789518264.315551:0:9506:0:(genops.c:885:class_export_put()) final put ffff8e73034e0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789518264.315597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73034e0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789518264.315620:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73034e3800 for lustre-OST0001 00010000:00010000:0.0:1789518264.373812:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518265.397623:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518266.421710:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518267.317588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518267.317616:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518267.317619:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518267.317622:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518267.317790:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522731392:0@lo:400:kworker.0 00000400:00000100:1.0:1789518267.317867:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522731392 offset 0 length 224: 4 00010000:00010000:0.0:1789518267.445717:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518268.469872:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518268.854345:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518258/real 1789518258] req@ffff8e73033d8380 x1876445522730496/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518268.854383:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e73033d8380 x1876445522730496/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518268.854413:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e34800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518268.854443:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789518268.854448:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522730496:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789518268.854644:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518268.854650:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789518268.854653:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7409e34800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518268.854658:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1789518268.854663:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.143@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789518268.854674:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.143@tcp: import ffff8e7409e34800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518268.854709:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e90e00 x1876445522731520/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518268.854734:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518268.854738:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789518268.855121:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518268.855136:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522731648:0@lo:400:kworker.0 00000400:00000100:0.0:1789518268.855214:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522731648 offset 0 length 224: 4 00000100:00100000:1.0:1789518268.855363:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522731520:0@lo:250:kworker.0 00000400:00000100:1.0:1789518268.855387:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445522731520 offset 0 length 520: 4 00010000:00010000:3.0:1789518269.493947:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518270.518950:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518271.541703:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518272.565682:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518272.953075:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518262/real 1789518262] req@ffff8e73033dad80 x1876445522731136/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518272 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518272.953110:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e73033dad80 x1876445522731136/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518272 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518272.953144:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e740d7b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789518272.953168:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1876445522731136:0@lo:39:umount.0 00000100:00080000:0.0:1789518272.956195:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789518272.956204:0:15502:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789518272.956212:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789518272.957251:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957269:0:15502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957297:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957305:0:15502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957335:0:15502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518272.957344:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957350:0:15502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957355:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957360:0:15502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518272.957379:0:15502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789518272.957384:0:15502:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789518272.957418:0:15502:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789518272.957422:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789518272.957427:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518272.957432:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518272.957436:0:15502:0:(genops.c:1557:class_disconnect_exports()) OBD device 19 (ffff8e74317ccd40) has no exports 00000020:00080000:0.0:1789518272.957459:0:15502:0:(genops.c:1557:class_disconnect_exports()) OBD device 19 (ffff8e74317ccd40) has no exports 00010000:00010000:3.0:1789518272.957506:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518272.957524:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957546:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9cc00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518272.957552:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957565:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518272.957591:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518272.957598:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518272.957602:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789518272.957606:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789518272.957630:0:7454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:3.0:1789518272.957635:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957642:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9cc00/0x8d0fd67942314266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231426d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957663:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518272.957668:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957675:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166d400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518272.957678:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957685:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518272.957691:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518272.957697:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789518272.957700:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789518272.957705:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789518272.957713:0:7454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:3.0:1789518272.957716:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957723:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e740166d400/0x8d0fd679423144ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd679423144d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518272.957735:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518272.957737:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518272.957740:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518272.959548:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789518272.961603:0:15502:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e730339fcc0 - data ffff8e740e320870/ffff8e73031f4c00 00000020:01000000:0.0:1789518272.961783:0:15502:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e73021ce000 - data ffff8e740e28c438/ffff8e743f838800 00100000:10000000:0.0:1789518272.973914:0:15502:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789518273.016039:0:15502:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313fcd 00000020:00000080:3.0:1789518273.016060:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e7435c93000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789518273.016086:0:15502:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7435dc1800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789518273.016091:0:15502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7435dc1800 2 00000020:01000004:3.0:1789518273.016095:0:15502:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e7435dc1800 from lustre-OST0000 00000020:00000080:3.0:1789518273.016141:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518273.016157:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789518273.016161:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e7435c95800/lustre-OST0000_UUID 00000020:00000080:3.0:1789518273.016165:0:15502:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7435c95800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789518273.016175:0:15502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789518273.016265:0:15502:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789518273.016271:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789518273.016276:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518273.016283:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789518273.016291:0:15502:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e73020d7800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789518273.016299:0:15502:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8e743b253380) has exports, disconnecting them 00000020:00080000:3.0:1789518273.016305:0:15502:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e73020d7800), last request at 1789518027 00000020:00000080:3.0:1789518273.016310:0:15502:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942314005 00000020:00080000:3.0:1789518273.016321:0:15502:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e73020d7800): rc 0 00000020:00000080:3.0:1789518273.016328:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e73020d7800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789518273.017338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7435c93000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789518273.017354:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73020d7800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789518273.018529:0:15502:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789518273.018540:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518273.018545:0:15502:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789518273.018555:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518273.018644:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e73020d3000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789518273.018793:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518273.018804:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789518273.018812:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e7437793000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789518273.018816:0:15502:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7437793000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789518273.018822:0:15502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789518273.018931:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789518273.019316:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518273.019327:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789518273.019336:0:15502:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8e7301973000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518273.019344:0:15502:0:(genops.c:1552:class_disconnect_exports()) OBD device 21 (ffff8e74217e8000) has exports, disconnecting them 00000020:00080000:2.0:1789518273.019349:0:15502:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8e7301973000), last request at 1789518027 00000020:00000080:2.0:1789518273.019355:0:15502:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231401a 00000020:00080000:2.0:1789518273.019376:0:15502:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7301973000): rc 0 00000020:00000080:2.0:1789518273.019382:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e7301973000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789518273.022216:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7301973000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789518273.058601:0:15502:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789518273.058617:0:15502:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789518273.058623:0:15502:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518273.058635:0:15502:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518273.058684:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e740d7b2800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789518273.058958:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518273.058970:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789518273.058977:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e7301973800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789518273.058981:0:15502:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7301973800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789518273.059006:0:15502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789518273.059111:0:15502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7435dc1800 1 00000020:00000080:0.0:1789518273.059128:0:15502:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313f72 00000020:00000080:0.0:1789518273.059138:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e743b39d800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789518273.059150:0:15502:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789518273.059160:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743b39d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789518273.059170:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518273.059177:0:15502:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518273.059182:0:15502:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8e743a5719c0) has no exports 00000020:00000080:0.0:1789518273.228192:0:15502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518273.228208:0:15502:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789518273.228215:0:15502:0:(genops.c:885:class_export_put()) final put ffff8e7441515800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789518273.228220:0:15502:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7441515800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789518273.228232:0:15502:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789518273.228355:0:15502:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e7435dc5000 00000020:02000400:0.0:1789518273.228401:0:15502:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789518273.590670:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518274.038781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518274.038815:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518274.038819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518274.038822:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789518274.039216:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518274.039245:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522731776:0@lo:400:kworker.0 00000400:00000100:2.0:1789518274.039323:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522731776 offset 0 length 224: 4 00010000:00010000:0.0:1789518274.616904:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518275.641634:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518276.661637:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518277.189461:0:15704:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789518277.196112:0:15704:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789518277.196218:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518277.196234:0:15704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518277.196242:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518277.196250:0:15704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518277.196267:0:15704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789518277.196273:0:15704:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789518277.196308:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518277.196323:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d2a00 x1876445522730880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789518282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518277.196337:0:15704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789518277.196343:0:15704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789518277.196350:0:15704:0:(import.c:65:import_set_state_nolock()) ffff8e7437796800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789518277.196356:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518277.196360:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d2a00 x1876445522730880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789518282 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518277.196366:0:15704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789518277.196370:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:3.0:1789518277.197342:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518277.197350:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518277.197358:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518277.197361:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518277.197367:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518277.197373:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518277.197376:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518277.197378:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518277.197380:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518277.197394:0:7454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:3.0:1789518277.197399:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518277.197405:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f9c400/0x8d0fd67942314235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231423c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518277.197418:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518277.197420:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518277.197421:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518277.197459:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522730880:0@lo:38:kworker.0 00000100:00080000:0.0:1789518277.200605:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789518277.200623:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d0e00 x1876445522731008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518277.200649:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7435e92300 x1876445522731264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518277.200675:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7435e92a00 x1876445522731392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518277.200737:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522731264:0@lo:400:kworker.0 00000100:00100000:0.0:1789518277.200765:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e7435e93b80 x1876445522731648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518277.200775:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d0a80 x1876445522731776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518290 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518277.200787:0:15704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789518277.200808:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522731648:0@lo:400:kworker.0 00000100:00100000:3.0:1789518277.200960:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522731008:0@lo:400:kworker.0 00000100:00100000:2.0:1789518277.201300:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522731776:0@lo:400:kworker.0 00000100:00100000:0.0:1789518277.201582:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522731392:0@lo:400:kworker.0 00000100:00080000:1.0:1789518277.201622:0:15704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789518277.201656:0:15704:0:(import.c:65:import_set_state_nolock()) ffff8e730292c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789518277.201712:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1876445522731904:0@lo:39:umount.0 00000400:00000100:2.0:1789518277.201774:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445522731904 offset 0 length 224: 4 00010000:00010000:3.0:1789518277.685662:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518278.709670:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518279.165259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518279.165273:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789518279.733597:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518280.758855:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518281.782532:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518282.808160:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518283.381604:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518268/real 1789518268] req@ffff8e7435e90e00 x1876445522731520/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518283 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518283.381643:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7435e90e00 x1876445522731520/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518283 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518283.381665:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e34800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518283.381698:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789518283.381702:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522731520:0@lo:250:kworker.0 00000100:00080000:0.0:1789518283.381963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518283.381969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789518283.381972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7409e34800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518283.381977:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1789518283.381982:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.143@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789518283.382012:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.143@tcp: import ffff8e7409e34800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518283.382078:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d1500 x1876445522732032/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518283.382161:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522732032:0@lo:250:kworker.0 00000400:00000100:2.0:1789518283.382211:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445522732032 offset 0 length 520: 4 00010000:00010000:3.0:1789518283.833789:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518284.857982:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518285.877810:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518286.901945:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518287.478721:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518277/real 1789518277] req@ffff8e743f938000 x1876445522731904/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518287 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518287.478759:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e743f938000 x1876445522731904/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518287 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518287.478785:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e730292c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789518287.478808:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1876445522731904:0@lo:39:umount.0 00000100:00080000:1.0:1789518287.478896:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789518287.478906:0:15704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789518287.478942:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789518287.484129:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484160:0:15704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484170:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484177:0:15704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484222:0:15704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518287.484232:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484241:0:15704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484248:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484254:0:15704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518287.484272:0:15704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789518287.484277:0:15704:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789518287.484314:0:15704:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789518287.484319:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789518287.484325:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518287.484353:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789518287.484359:0:15704:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8e7302ac0000) has no exports 00000020:00080000:1.0:1789518287.484391:0:15704:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8e7302ac0000) has no exports 00010000:00010000:0.0:1789518287.484554:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518287.484575:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484589:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435dce600 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518287.484594:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484605:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518287.484612:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518287.484617:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518287.484620:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789518287.484623:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789518287.484643:0:7454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:0.0:1789518287.484647:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484653:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dce600/0x8d0fd67942314243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd6794231424a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484667:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518287.484670:0:7454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484707:0:7454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518287.484710:0:7454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484717:0:7454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518287.484722:0:7454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518287.484727:0:7454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789518287.484729:0:7454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789518287.484730:0:7454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789518287.484745:0:7454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:0.0:1789518287.484748:0:7454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484754:0:7454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c400/0x8d0fd679423144c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd679423144c7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518287.484767:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518287.484769:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518287.484771:0:7454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518287.485755:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789518287.492595:0:15704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e74062dbc60 - data ffff8e740e321d80/ffff8e743b421000 00000020:01000000:1.0:1789518287.493431:0:15704:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e743156df60 - data ffff8e740e31a438/ffff8e730204a400 00100000:10000000:1.0:1789518287.506714:0:15704:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789518287.525516:0:15704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423140d0 00000020:00000080:0.0:1789518287.525533:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e743a54b800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789518287.525552:0:15704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e730205a000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789518287.525557:0:15704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e730205a000 2 00000020:01000004:0.0:1789518287.525561:0:15704:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e730205a000 from lustre-OST0001 00000020:00000080:0.0:1789518287.525587:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518287.525610:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789518287.525614:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e740d7b7000/lustre-OST0001_UUID 00000020:00000080:0.0:1789518287.525617:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e740d7b7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789518287.525624:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1789518287.525776:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743a54b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1789518287.526088:0:15704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ecfb1fc7-85a9-4c59-b070-db791c081ea7->MGS 00010000:00010000:2.0:1789518287.526108:0:15704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942313e29 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd67942313e30 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518287.526122:0:15704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942313e29 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd67942313e30 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518287.526128:0:15704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789518287.526131:0:15704:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789518287.526133:0:15704:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789518287.526150:0:15704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:2.0:1789518287.526153:0:15704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942313e29 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd67942313e30 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518287.526170:0:15704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8d0fd679423142b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518287.526177:0:15704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8d0fd679423142b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518287.526189:0:15704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518287.526192:0:15704:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789518287.526194:0:15704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789518287.526212:0:15704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e7409e34800 00010000:00010000:2.0:1789518287.526215:0:15704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435dcf200/0x8d0fd679423142ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8d0fd679423142b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518287.526232:0:15704:0:(import.c:65:import_set_state_nolock()) ffff8e7409e34800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789518287.526236:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789518287.526238:0:15704:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789518287.526240:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789518287.526245:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789518287.526257:0:15704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e74079d1500 x1876445522732032/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789518303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789518287.526278:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789518287.526281:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1789518287.526394:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfb1fc7-85a9-4c59-b070-db791c081ea7:3636:1876445522732032:0@lo:250:kworker.0 10000000:01000000:2.0:1789518287.526595:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518287.526609:0:15704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd67942313d26 00000020:00000080:2.0:1789518287.526618:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e7431795800/ecfb1fc7-85a9-4c59-b070-db791c081ea7 00000020:01000000:2.0:1789518287.526648:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.143@tcp (flags='') 00000020:00000080:2.0:1789518287.526658:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518287.526676:0:15704:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518287.526682:0:15704:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8e740dd9cd40) has no exports 00000020:00000080:3.0:1789518287.526847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7431795800/ecfb1fc7-85a9-4c59-b070-db791c081ea7 for MGC192.168.202.143@tcp 10000000:01000000:0.0:1789518287.528647:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789518287.529054:0:15704:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.143@tcp: client import never connected 00000100:00080000:2.0:1789518287.529062:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789518287.529068:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789518287.529073:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789518287.529077:0:15704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518287.529158:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518287.529169:0:15704:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.143@tcp (uuid ecfb1fc7-85a9-4c59-b070-db791c081ea7) 00000020:01000000:2.0:1789518287.529180:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789518287.529211:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518287.529218:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789518287.529227:0:15704:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e7437795000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518287.529236:0:15704:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8e73030e99c0) has exports, disconnecting them 00000020:00080000:2.0:1789518287.529242:0:15704:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e7437795000), last request at 1789518053 00000020:00000080:2.0:1789518287.529247:0:15704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd679423140fa 00000020:00080000:2.0:1789518287.529266:0:15704:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7437795000): rc 0 00000020:00000080:2.0:1789518287.529271:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e7437795000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789518287.529573:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7409e34800 for MGC192.168.202.143@tcp 00000020:00000080:3.0:1789518287.529583:0:8:0:(genops.c:885:class_export_put()) final put ffff8e7409e37800/ecfb1fc7-85a9-4c59-b070-db791c081ea7 00000020:00000080:3.0:1789518287.529586:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7409e37800/ecfb1fc7-85a9-4c59-b070-db791c081ea7 for MGC192.168.202.143@tcp 00000020:01000000:3.0:1789518287.529593:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.143@tcp (ecfb1fc7-85a9-4c59-b070-db791c081ea7) 00000020:00000080:3.0:1789518287.534059:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7437795000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789518287.534158:0:15704:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789518287.534165:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518287.534170:0:15704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789518287.534177:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518287.535576:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518287.535592:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789518287.535601:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789518287.535607:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518287.535612:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789518287.535633:0:15704:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8e7302929000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789518287.535641:0:15704:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8e7303203380) has exports, disconnecting them 00000020:00080000:3.0:1789518287.535647:0:15704:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8e7302929000), last request at 1789518053 00000020:00000080:3.0:1789518287.535653:0:15704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231410f 00000020:00080000:3.0:1789518287.535798:0:15704:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e7302929000): rc 0 00000020:00000080:3.0:1789518287.535805:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e7302929000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1789518287.538409:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e7437796800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789518287.538433:0:8:0:(genops.c:885:class_export_put()) final put ffff8e73020d5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789518287.538438:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e73020d5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789518287.538481:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789518287.538578:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e7302929000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789518287.540623:0:15704:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789518287.540631:0:15704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789518287.540636:0:15704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518287.540644:0:15704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518287.540689:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e730292c800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789518287.567636:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789518287.567728:0:7454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789518287.568363:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789518287.568591:0:10332:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8e740ddbf800:10332] 2 exiting: rc = 0 00000100:00100000:2.0:1789518287.568789:0:6495:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e74395f8600:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1789518287.569047:0:6496:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e741122ee00:6496] 1 exiting: rc = 0 00000100:00100000:0.0:1789518287.569129:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518287.570093:0:6497:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e7407310a00:6497] 0 exiting: rc = 1 00000100:00100000:2.0:1789518287.570207:0:6498:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e7407311000:6498] 1 exiting: rc = 0 00000100:00100000:3.0:1789518287.571004:0:9516:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e7302062000:9516] 3 exiting: rc = 0 00000100:00100000:3.0:1789518287.571130:0:6499:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e7413816400:6499] 2 exiting: rc = 0 00000100:00100000:0.0:1789518287.571209:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571219:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571227:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571234:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571241:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571247:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571254:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571262:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571268:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571276:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571282:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571289:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571295:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571331:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571339:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571346:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571352:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571358:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571367:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571375:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571381:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571387:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571392:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571398:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571404:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571410:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571416:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571421:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571429:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571435:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571441:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571447:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571453:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571458:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571733:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571741:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571747:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571752:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571757:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571762:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571768:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571773:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571779:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571785:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571791:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571797:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571802:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571808:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571823:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571830:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571835:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571842:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571847:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571852:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571858:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571864:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571868:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571873:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571879:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571950:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571958:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571964:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571969:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.571975:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789518287.576663:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518287.576685:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789518287.576694:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e730292d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789518287.576701:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e730292d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789518287.576709:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789518287.576801:0:15704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e730205a000 1 00000020:00000080:0.0:1789518287.576809:0:15704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8d0fd6794231409f 00000020:00000080:0.0:1789518287.576817:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e743f888800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789518287.577023:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789518287.577028:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518287.577036:0:15704:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518287.577041:0:15704:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8e74317c8000) has no exports 00000020:00000080:2.0:1789518287.584076:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743f888800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789518287.633329:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518287.633355:0:15704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789518287.633364:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e730205a800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789518287.633371:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e730205a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789518287.633379:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789518287.634212:0:15704:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e730205e000 00000020:01000000:0.0:1789518287.634243:0:15704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789518287.634249:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518287.634255:0:15704:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518287.634269:0:15704:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8e743b2519c0) has no exports 00000020:00000080:0.0:1789518287.634304:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518287.634313:0:15704:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789518287.634317:0:15704:0:(genops.c:885:class_export_put()) final put ffff8e743b398800/OSS_uuid 00000020:00000080:0.0:1789518287.634320:0:15704:0:(genops.c:844:class_export_destroy()) destroying export ffff8e743b398800/OSS_uuid for OSS 00000020:01000000:0.0:1789518287.634325:0:15704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789518287.634406:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789518287.637823:0:13804:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8e7303787c00:13804] 4 exiting: rc = 0 00000100:00100000:2.0:1789518287.638121:0:8427:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8e7435d18000:8427] 0 exiting: rc = 1 00000100:00100000:2.0:1789518287.638380:0:8429:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8e7435c72800:8429] 2 exiting: rc = 0 00000100:00100000:2.0:1789518287.638940:0:9982:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8e7302abc000:9982] 3 exiting: rc = 0 00000100:00100000:0.0:1789518287.644500:0:8428:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8e7420514000:8428] 1 exiting: rc = 0 00000100:00100000:0.0:1789518287.644734:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644763:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644776:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644787:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644796:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644801:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644806:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644812:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644817:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644823:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644829:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644836:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644842:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644847:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644852:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644858:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644864:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644870:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644877:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644883:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644890:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644894:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644900:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644907:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644929:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644935:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644941:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644947:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644952:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644957:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644963:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644969:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644975:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644981:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.644998:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645004:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645009:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645015:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645020:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645025:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645031:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645036:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645044:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645050:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645056:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645061:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645067:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645084:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645092:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645098:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645105:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645111:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645117:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645122:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645128:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645133:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645139:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645145:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645152:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645168:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645174:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645180:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645186:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.645194:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518287.646373:0:8430:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e7435c72200:8430] 0 exiting: rc = 1 00000100:00100000:2.0:1789518287.646550:0:12153:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8e743b7a0c00:12153] 2 exiting: rc = 0 00000100:00100000:3.0:1789518287.646660:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e7435c73600:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1789518287.649187:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.649212:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.649222:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.649228:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.649235:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.649241:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.649247:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.649253:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650257:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650342:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650349:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650354:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650361:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650367:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650373:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650379:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650384:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650391:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650913:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650920:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650926:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650933:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650938:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650944:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650950:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650957:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650965:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650972:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650978:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.650993:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651020:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651026:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651032:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651038:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651043:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651048:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651054:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651060:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651065:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651070:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651558:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651565:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651571:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651577:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651583:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651589:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651594:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.651600:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652856:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652865:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652872:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652878:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652886:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652894:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652900:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652907:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652914:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652924:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652930:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652936:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652943:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652949:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652955:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.652980:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518287.663011:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e740dcd2a00:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1789518287.663104:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e7441693800:8434] 2 exiting: rc = 0 00000100:00100000:1.0:1789518287.663457:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e7441692e00:8433] 1 exiting: rc = 0 00000100:00100000:0.0:1789518287.664457:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664504:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664510:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664520:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664526:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664533:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664540:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664547:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664552:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664560:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664567:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664573:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664579:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664586:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664592:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664600:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664608:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664624:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664632:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664640:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.664646:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665147:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665160:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665167:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665174:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665181:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665188:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665220:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665227:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665231:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665236:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665242:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665247:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.665251:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666504:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666530:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666552:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666559:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666567:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666574:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666580:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666587:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666595:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666603:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666619:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666625:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666632:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666638:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.666644:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.667354:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.667391:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668012:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668027:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668050:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668216:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668224:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668228:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668238:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668247:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668253:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668749:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668758:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668763:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.668768:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518287.698362:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e7435c9b600:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1789518287.699360:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e7435c9ac00:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1789518287.700003:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700015:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700022:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700028:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700034:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700040:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700045:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700051:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700057:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700063:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700069:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700153:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700160:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700166:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700172:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700177:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700182:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700188:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700194:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700199:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700206:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700213:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700218:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700224:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700230:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700235:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700241:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700333:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700340:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700346:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700351:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700356:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700362:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700368:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700373:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700379:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700385:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700390:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700604:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700734:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700744:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700750:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700756:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700762:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700768:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700773:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700837:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700843:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700849:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700855:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700860:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700867:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700872:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700879:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700886:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700893:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700899:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700906:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700912:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700919:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700925:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700932:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700949:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518287.700955:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518287.704942:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e74317a4000:8438] 1 exiting: rc = 0 00000100:00100000:1.0:1789518287.705373:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e74317a5200:8437] 0 exiting: rc = 1 00000100:00100000:0.0:1789518287.706572:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706601:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706823:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706833:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706840:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706847:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706880:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706888:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706895:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706903:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706910:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706919:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706927:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706935:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706959:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706967:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706974:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.706994:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707002:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707009:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707015:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707021:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707028:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707034:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707040:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707046:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707068:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707203:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707212:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707220:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707228:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707235:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707243:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707252:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707323:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707332:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707339:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707346:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707368:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707376:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707383:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707750:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707762:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707772:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707833:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707842:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707850:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707858:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707865:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707872:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707899:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707909:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707917:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707925:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707932:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707938:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707946:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707953:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707960:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707968:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707976:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.707995:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.708018:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518287.708036:0:15704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789518287.738729:0:15704:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789518308.248927:0:16469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789518318.503585:0:17069:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789518318.503593:0:17069:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789518318.503595:0:17069:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789518318.503751:0:17069:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e743f99c000 00000020:01000004:2.0:1789518318.503771:0:17069:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789518318.503780:0:17069:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789518318.503809:0:17069:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e73030ecd40) 00000020:00000080:2.0:1789518318.503828:0:17069:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789518318.658521:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789518318.661642:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789518318.669308:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1789518318.670381:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789518318.674765:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789518318.676671:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1789518318.677200:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789518318.680081:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1789518318.682778:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789518318.683805:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789518318.687635:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1789518318.690014:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789518318.691291:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789518318.692831:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789518318.697439:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.699401:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.702690:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.703183:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.703527:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.704768:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.706198:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.709014:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.717066:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.719155:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.720104:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.720522:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.720870:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.721108:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.721509:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.721849:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.722097:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.722511:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.722838:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.723087:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.723324:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.723614:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.723956:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.724394:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.724680:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.724902:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.725728:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.726017:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.726269:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.726802:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789518318.727073:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.727579:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789518318.732068:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789518318.733064:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789518318.733795:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789518318.734282:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789518318.734962:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789518318.735162:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789518318.735881:0:17069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1789518318.737072:0:17069:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789518318.737339:0:17069:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789518318.737350:0:17069:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789518318.737383:0:17069:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd679423152d5 00000020:01000004:2.0:1789518318.737392:0:17069:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789518318.737398:0:17069:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789518318.737405:0:17069:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e743f99c000 from MGS 00000020:01000004:2.0:1789518318.737410:0:17069:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789518318.737424:0:17069:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e73030e8000) 00000020:00000080:2.0:1789518318.737436:0:17069:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789518318.739690:0:17069:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e743f99c000 from MGS, refs=2 00080000:01000000:2.0:1789518318.739722:0:17069:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789518318.739736:0:17069:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd679423152e3 00000100:00100000:2.0:1789518318.739922:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789518318.740095:0:17069:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789518318.740102:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789518318.741689:0:17069:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789518318.741715:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789518318.748691:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518318.750164:0:17069:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789518318.750178:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789518318.751116:0:17069:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789518318.751127:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789518318.751754:0:17069:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789518318.751763:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789518318.752763:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518318.752769:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518318.752771:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518318.760711:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518318.760723:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518318.760726:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518318.762205:0:17069:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789518318.762798:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789518318.779008:0:17069:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789518318.782535:0:17081:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789518318.783153:0:17069:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789518318.783224:0:17069:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789518318.786081:0:17069:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789518318.787218:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518318.787878:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789518318.787888:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789518318.788875:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789518318.788886:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789518318.789200:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789518318.789206:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1789518318.793027:0:17086:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789518318.793271:0:17069:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789518318.793298:0:17069:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.143@tcp' 00000020:01000004:2.0:1789518318.793300:0:17069:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789518318.793339:0:17069:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.143@tcp (typ=mgc) 00000020:00000080:2.0:1789518318.793356:0:17069:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.143@tcp (ffff8e73030e99c0) 00000020:00000080:2.0:1789518318.793377:0:17069:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789518318.801251:0:17069:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7303d0e000@MGC192.168.202.143@tcp: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518318.801844:0:17069:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.143@tcp-0 is initialized 00000040:01000000:3.0:1789518318.801856:0:17069:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789518318.804647:0:17087:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789518318.804736:0:17069:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.143@tcp (uuid 6224dd85-753f-4c3f-83da-7a6019473f75) 00000020:00000080:2.0:1789518318.804767:0:17069:0:(genops.c:1384:class_connect()) connect: client 6224dd85-753f-4c3f-83da-7a6019473f75, cookie 0x8d0fd679423152f1 00000100:00080000:2.0:1789518318.804785:0:17069:0:(import.c:545:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518318.804803:0:17069:0:(import.c:666:import_select_connection()) MGC192.168.202.143@tcp: import ffff8e7303d0e000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518318.804856:0:17069:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033dad80 x1876445522732160/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518318.804922:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6224dd85-753f-4c3f-83da-7a6019473f75:3636:1876445522732160:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789518318.805017:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789518318.805098:0:17069:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6224dd85-753f-4c3f-83da-7a6019473f75->MGS 00000020:01000004:2.0:1789518318.805125:0:17069:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789518318.805142:0:17069:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789518318.805162:0:17069:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e73030eb380) 00000020:00000080:2.0:1789518318.805179:0:17069:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789518318.811635:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522732160 00000100:00100000:1.0:1789518318.811657:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522732160 00000100:00100000:1.0:1789518318.811724:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518318.811734:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1876445522732160:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789518318.811775:0:17082:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6224dd85-753f-4c3f-83da-7a6019473f75@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1789518318.811816:0:17082:0:(genops.c:1384:class_connect()) connect: client 6224dd85-753f-4c3f-83da-7a6019473f75, cookie 0x8d0fd679423152ff 00000100:00080000:1.0:1789518318.811994:0:17082:0:(import.c:65:import_set_state_nolock()) ffff8e7303c12000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518318.812136:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+5:3636:x1876445522732160:12345-0@lo:250:mount.lustre.0 Request processed in 401us (7118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518318.812145:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518318.815891:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789518318.815917:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.143@tcp: connect to target with instance 0 00000100:00080000:3.0:1789518318.815930:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789518318.815940:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789518318.815947:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7303d0e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789518318.815952:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789518318.815957:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789518318.815969:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6224dd85-753f-4c3f-83da-7a6019473f75:3636:1876445522732160:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789518318.828541:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518318.828766:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789518318.828773:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789518318.848236:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789518318.848252:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789518318.848796:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789518318.848803:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789518318.850606:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518318.850989:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789518318.851009:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789518318.851685:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789518318.851694:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789518318.930280:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518318.930528:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789518318.930534:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789518318.942756:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789518318.942792:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789518318.945952:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518318.946184:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518318.946190:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789518318.946891:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518318.946900:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789518318.947426:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518318.947629:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518318.947634:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789518318.948899:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789518318.948909:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789518318.949429:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518318.949706:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518318.949711:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789518318.964381:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518318.964397:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789518319.012442:0:17069:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518319.016112:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789518319.016121:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789518319.027297:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789518319.027317:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789518319.041065:0:17069:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518319.041109:0:17069:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789518319.042151:0:17069:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789518319.042184:0:17069:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789518319.042191:0:17069:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789518319.042304:0:17069:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789518319.042338:0:17069:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789518319.042343:0:17069:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789518319.042345:0:17069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518319.042346:0:17069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518319.042347:0:17069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518319.042348:0:17069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518319.042349:0:17069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518319.042350:0:17069:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518319.042351:0:17069:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518319.042353:0:17069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518319.042355:0:17069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518319.042357:0:17069:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789518319.042359:0:17069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518319.042361:0:17069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518319.042362:0:17069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518319.042363:0:17069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518319.042364:0:17069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518319.042365:0:17069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518319.042366:0:17069:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518319.042367:0:17069:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518319.042368:0:17069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518319.042369:0:17069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518319.042398:0:17069:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789518319.042423:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732288:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789518319.042543:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518319.042600:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7402afdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518319.042968:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522732288 00000100:00100000:1.0:1789518319.042976:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522732288 00000100:00100000:1.0:1789518319.043030:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518319.043039:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+5:17069:x1876445522732288:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518319.043088:0:17084:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789518319.043091:0:17084:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789518319.043094:0:17084:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789518319.052516:0:17106:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789518319.056887:0:17084:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1789518319.065261:0:17107:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789518319.065271:0:17107:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789518319.065275:0:17107:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789518319.065277:0:17107:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789518319.065639:0:17107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789518319.065818:0:17084:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789518319.065834:0:17084:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789518319.067415:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732288:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789518319.067436:0:17069:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789518319.067439:0:17069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518319.067440:0:17069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518319.067442:0:17069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518319.067443:0:17069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518319.067445:0:17069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518319.067446:0:17069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518319.067447:0:17069:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518319.067449:0:17069:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518319.067450:0:17069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518319.067452:0:17069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:1.0:1789518319.067593:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+5:17069:x1876445522732288:12345-0@lo:253:mount.lustre.0 Request processed in 24546us (25040us total) trans 0 rc 0/0 00000020:01000004:2.0:1789518319.067656:0:17069:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e743f99c000 from lustre-MDT0000 10000000:01000000:2.0:1789518319.067720:0:17069:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789518319.067724:0:17069:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00000100:00100000:1.0:1789518319.067731:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:2.0:1789518319.067733:0:17069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e73030e99c0 10000000:01000000:2.0:1789518319.067750:0:17069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518319.067760:0:17069:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e73030e99c0 from 1 10000000:01000000:2.0:1789518319.067763:0:17069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789518319.067810:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.067821:0:17069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.067830:0:17069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518319.067849:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518319.067911:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518319.067987:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518319.068099:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522732416 00000100:00100000:0.0:1789518319.068105:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522732416 00000100:00100000:0.0:1789518319.068178:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518319.068189:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+5:17069:x1876445522732416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518319.068202:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518319.068216:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7200/0x8d0fd6794231530d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315306 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.068248:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7200/0x8d0fd6794231530d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315306 expref: 6 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.068260:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7200/0x8d0fd6794231530d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315306 expref: 6 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.068275:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7200, rc 0) 00000100:00100000:0.0:1789518319.068323:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+6:17069:x1876445522732416:12345-0@lo:101:mount.lustre.0 Request processed in 136us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518319.068330:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518319.068732:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518319.068760:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.068790:0:17069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518319.068889:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518319.068940:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.068984:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7407d0b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518319.069004:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522732544 00000100:00100000:0.0:1789518319.069013:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522732544 00000100:00100000:0.0:1789518319.069092:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518319.069100:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+6:17069:x1876445522732544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518319.069209:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+6:17069:x1876445522732544:12345-0@lo:501:mount.lustre.0 Request processed in 110us (268us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518319.069219:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518319.069259:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732544:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789518319.069297:0:17069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789518319.069847:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.069862:0:17069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518319.069874:0:17069:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e743f99c000 10000000:01000000:1.0:1789518319.069882:0:17069:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789518319.069887:0:17069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e743f99c000 10000000:01000000:1.0:1789518319.069890:0:17069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789518319.069894:0:17069:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e743f99c000 from 1 10000000:01000000:1.0:1789518319.069897:0:17069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789518319.069931:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0de00/0x8d0fd67942315314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.069940:0:17069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0de00/0x8d0fd67942315314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.069950:0:17069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0de00/0x8d0fd67942315314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518319.069978:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518319.070047:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.070094:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7407d0b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.070224:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522732672 00000100:00100000:2.0:1789518319.070233:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522732672 00000100:00100000:2.0:1789518319.070277:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518319.070286:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+6:17069:x1876445522732672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518319.070635:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518319.070655:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ad600/0x8d0fd6794231531b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315314 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.070681:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ad600/0x8d0fd6794231531b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315314 expref: 7 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.070691:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ad600/0x8d0fd6794231531b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315314 expref: 7 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.070713:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad600, rc 0) 00000100:00100000:2.0:1789518319.070790:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+7:17069:x1876445522732672:12345-0@lo:101:mount.lustre.0 Request processed in 506us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.070796:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518319.070959:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518319.070978:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0de00/0x8d0fd67942315314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231531b expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.070988:0:17069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0de00/0x8d0fd67942315314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231531b expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518319.071005:0:17069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789518319.072458:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0de00/0x8d0fd67942315314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231531b expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.073608:0:17069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0de00/0x8d0fd67942315314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231531b expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518319.073619:0:17069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789518319.073728:0:17069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518319.073737:0:17069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e743f99c000 10000000:01000000:2.0:1789518319.073740:0:17069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789518319.073744:0:17069:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789518319.073747:0:17069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789518319.073789:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ada00/0x8d0fd67942315322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.073797:0:17069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ada00/0x8d0fd67942315322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.073808:0:17069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ada00/0x8d0fd67942315322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518319.073832:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518319.074092:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518319.074212:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522732800 00000100:00100000:0.0:1789518319.074220:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522732800 00000100:00100000:0.0:1789518319.074274:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518319.074282:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+7:17069:x1876445522732800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518319.074295:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518319.074308:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b6e00/0x8d0fd67942315329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315322 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.074329:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b6e00/0x8d0fd67942315329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315322 expref: 8 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.074340:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b6e00/0x8d0fd67942315329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315322 expref: 8 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.074348:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6e00, rc 0) 00000100:00100000:0.0:1789518319.074567:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+8:17069:x1876445522732800:12345-0@lo:101:mount.lustre.0 Request processed in 285us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518319.074581:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518319.074693:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.074726:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518319.074741:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ada00/0x8d0fd67942315322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315329 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.074751:0:17069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ada00/0x8d0fd67942315322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942315329 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518319.074816:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518319.074841:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518319.074893:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518319.074998:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522732928 00000100:00100000:0.0:1789518319.075003:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522732928 00000100:00100000:0.0:1789518319.075068:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518319.075076:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+8:17069:x1876445522732928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518319.075310:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+9:17069:x1876445522732928:12345-0@lo:501:mount.lustre.0 Request processed in 234us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518319.075318:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518319.075487:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522732928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518319.075528:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522733056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518319.075564:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518319.075631:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518319.075677:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522733056 00000100:00100000:0.0:1789518319.075682:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522733056 00000100:00100000:0.0:1789518319.075725:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518319.075732:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+9:17069:x1876445522733056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518319.076302:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+9:17069:x1876445522733056:12345-0@lo:503:mount.lustre.0 Request processed in 570us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518319.076311:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518319.076391:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522733056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518319.076867:0:17108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17108:1876445522733184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518319.076977:0:17108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.077009:0:17108:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7407d0b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.077061:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522733184 00000100:00100000:2.0:1789518319.077068:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522733184 00000100:00100000:2.0:1789518319.077103:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518319.077264:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+9:17108:x1876445522733184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518319.078807:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+9:17108:x1876445522733184:12345-0@lo:502:llog_process_th.0 Request processed in 1691us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.078819:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518319.079029:0:17108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17108:1876445522733184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518319.079060:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518319.079069:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518319.079072:0:17108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789518319.079076:0:17108:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789518319.079085:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518319.079100:0:17108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e7302ac19c0) 00000020:00000080:1.0:1789518319.079115:0:17108:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789518319.079120:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789518319.079216:0:17108:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789518319.079224:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942315337 00000020:00000080:1.0:1789518319.079418:0:17108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789518319.079422:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518319.079425:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518319.079427:0:17108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789518319.079430:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518319.079434:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518319.079435:0:17108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789518319.079438:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518319.079445:0:17108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e7302ac3380) 00000020:00000080:1.0:1789518319.079455:0:17108:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789518319.079459:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789518319.079652:0:17108:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789518319.079656:0:17108:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789518319.079665:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789518319.079721:0:17108:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e743f99c000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789518319.079734:0:17108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e7302ac4d40) 00000020:00000080:1.0:1789518319.079743:0:17108:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789518319.079800:0:17108:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789518319.079806:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd6794231534c 00000020:00000080:1.0:1789518319.079892:0:17108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789518319.079898:0:17108:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789518319.079902:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8d0fd67942315353 00080000:01000000:1.0:1789518319.080262:0:17108:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789518319.080269:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd6794231535a 00010000:00010000:3.0:1789518319.152276:0:17108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789518319.153156:0:17108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789518319.153692:0:17108:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789518319.154256:0:17108:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e73034f8000) 00000020:00000080:3.0:1789518319.154273:0:17108:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789518319.154356:0:17108:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789518319.154382:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942315368 00000020:00000080:3.0:1789518319.154875:0:17108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789518319.168853:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8d0fd6794231536f 00000020:00000080:3.0:1789518319.169246:0:17108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789518319.169259:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518319.169266:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.169268:0:17108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789518319.169271:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789518319.169274:0:17108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789518319.169275:0:17108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518319.169277:0:17108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518319.169278:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789518319.169280:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.169282:0:17108:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789518319.169284:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518319.169289:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.169291:0:17108:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789518319.169295:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789518319.169340:0:17108:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789518319.169383:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518319.169387:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.169388:0:17108:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789518319.169391:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518319.169394:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.169395:0:17108:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789518319.169397:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518319.169402:0:17108:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:00000080:3.0:1789518319.169428:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518319.169444:0:17108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e73034f99c0) 00000020:00000080:3.0:1789518319.169456:0:17108:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789518319.169460:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518319.169545:0:17108:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789518319.169551:0:17108:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789518319.169559:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd6794231537d 00010000:00080000:3.0:1789518319.169592:0:17108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e74416ed000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518319.172183:0:17108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789518319.180281:0:17108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518319.180307:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789518319.180365:0:17108:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789518319.180400:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd67942315384 00000100:00080000:2.0:1789518319.180413:0:17108:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518319.180425:0:17108:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e74416ed000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518319.180660:0:17108:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033db100 x1876445522733312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518319.180683:0:17108:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789518319.182777:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518319.182858:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789518319.183240:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518319.183248:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.183251:0:17108:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789518319.183255:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789518319.183258:0:17108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789518319.183260:0:17108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789518319.183261:0:17108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789518319.183263:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789518319.183265:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.183266:0:17108:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789518319.183269:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789518319.183275:0:17108:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789518319.183279:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.183280:0:17108:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789518319.183283:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789518319.183287:0:17108:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:2.0:1789518319.183309:0:17108:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789518319.183312:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518319.183348:0:17108:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e743cdd3380) 00000020:00000080:2.0:1789518319.183367:0:17108:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789518319.185207:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789518319.185309:0:17108:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789518319.185316:0:17108:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789518319.185337:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd67942315392 00010000:00080000:2.0:1789518319.185376:0:17108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e74416e4800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789518319.185613:0:17108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1789518319.189392:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522733312 00000100:00100000:3.0:1789518319.189411:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522733312 00000100:00100000:3.0:1789518319.189456:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518319.189489:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1876445522733312:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789518319.189511:0:17095:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789518319.190295:0:17108:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789518319.191564:0:17108:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789518319.200530:0:17108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518319.203967:0:17108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:3.0:1789518319.211007:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1876445522733312:12345-0@lo:38:llog_process_th.0 Request processed in 21506us (28135us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518319.211027:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789518319.211079:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518319.211092:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518319.211097:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733312:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789518319.213287:0:17108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789518319.221720:0:17114:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789518319.221729:0:17114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789518319.223103:0:17108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518319.223117:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789518319.223163:0:17108:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789518319.223184:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd67942315399 00000100:00080000:3.0:1789518319.223195:0:17108:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518319.223215:0:17108:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e74416e4800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518319.223259:0:17108:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e92d80 x1876445522733440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518319.223295:0:17108:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789518319.223353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789518319.223357:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789518319.223359:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518319.223363:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1789518319.223367:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789518319.223372:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e74416ed000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518319.223542:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733440:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789518319.223595:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522733440 offset 0 length 520: 4 00000100:00100000:3.0:1789518319.223758:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e90000 x1876445522733696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518319.223811:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522733568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518319.223850:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789518319.223996:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518319.224001:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.224003:0:17108:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789518319.224007:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789518319.224009:0:17108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789518319.224011:0:17108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518319.224012:0:17108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518319.224014:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789518319.224017:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.224018:0:17108:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789518319.224020:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518319.224024:0:17108:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789518319.224028:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.224029:0:17108:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789518319.224038:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518319.224043:0:17108:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:3.0:1789518319.224065:0:17108:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789518319.224068:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518319.224080:0:17108:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e73034fb380) 00000020:00000080:3.0:1789518319.224092:0:17108:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789518319.224098:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518319.224163:0:17108:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789518319.224169:0:17108:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789518319.224175:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8d0fd679423153a7 00010000:00080000:3.0:1789518319.224200:0:17108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7402e82000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518319.224546:0:17108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789518319.224611:0:17108:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789518319.224626:0:17108:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1789518319.224827:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733696:0@lo:38:kworker.0 00000100:00100000:1.0:1789518319.224868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.225163:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522733696 00000100:00100000:3.0:1789518319.225171:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522733696 00000100:00100000:3.0:1789518319.225200:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518319.225208:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1876445522733696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789518319.225224:0:17096:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789518319.225269:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1876445522733696:12345-0@lo:38:kworker.0 Request processed in 61us (400us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518319.225275:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789518319.225314:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518319.225318:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518319.225322:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733696:0@lo:38:kworker.0 00000100:00100000:2.0:1789518319.227650:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522733568 00000100:00100000:2.0:1789518319.227662:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522733568 00000100:00100000:2.0:1789518319.227728:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518319.227739:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+9:3640:x1876445522733568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518319.227833:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+9:3640:x1876445522733568:12345-0@lo:400:kworker.0 Request processed in 96us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.227841:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518319.228057:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522733568:0@lo:400:kworker.0 00000040:00080000:2.0:1789518319.230033:0:17108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789518319.231084:0:17108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789518319.231252:0:17108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789518319.231801:0:17116:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789518319.231806:0:17116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789518319.232622:0:17108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518319.232634:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789518319.232671:0:17108:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789518319.232691:0:17108:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd679423153ae 00000100:00080000:2.0:1789518319.232712:0:17108:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518319.232724:0:17108:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7402e82000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518319.232759:0:17108:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033da300 x1876445522733824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518319.232783:0:17108:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789518319.232882:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733824:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789518319.232961:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522733824 offset 0 length 520: 4 00000020:01000000:2.0:1789518319.233659:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518319.233665:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.233667:0:17108:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789518319.233676:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518319.233681:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.233682:0:17108:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789518319.233685:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789518319.233687:0:17108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789518319.233689:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518319.233701:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.233703:0:17108:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789518319.233706:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518319.233709:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.233710:0:17108:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789518319.233713:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789518319.233745:0:17108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17108:1876445522733952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518319.234167:0:17108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518319.234205:0:17108:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518319.234256:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522733952 00000100:00100000:3.0:1789518319.234265:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522733952 00000100:00100000:3.0:1789518319.234311:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518319.234321:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+9:17108:x1876445522733952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.234454:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+9:17108:x1876445522733952:12345-0@lo:502:llog_process_th.0 Request processed in 134us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.234486:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518319.234712:0:17108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17108:1876445522733952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518319.234738:0:17108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518319.234742:0:17108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.234744:0:17108:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789518319.234747:0:17108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789518319.235149:0:17069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789518319.235175:0:17069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789518319.235199:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ada00/0x8d0fd67942315322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315329 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.235211:0:17069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ada00/0x8d0fd67942315322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315329 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518319.235220:0:17069:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e743f99c000 from 1 10000000:01000000:3.0:1789518319.235223:0:17069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518319.235254:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.235263:0:17069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.235273:0:17069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518319.235291:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518319.235338:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.235381:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74112519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518319.235507:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734080 00000100:00100000:0.0:1789518319.235514:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734080 00000100:00100000:0.0:1789518319.235550:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518319.235559:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+9:17069:x1876445522734080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518319.235568:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518319.235587:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423153b5 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.235610:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 10 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.235622:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 10 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.235630:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7a00, rc 0) 00000100:00100000:0.0:1789518319.235665:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+10:17069:x1876445522734080:12345-0@lo:101:mount.lustre.0 Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518319.235672:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518319.236070:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518319.236087:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.236096:0:17069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518319.237088:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734208:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789518319.237146:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.237222:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74112519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.237620:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734208 00000100:00100000:2.0:1789518319.237629:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734208 00000100:00100000:2.0:1789518319.237726:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518319.237735:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+10:17069:x1876445522734208:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789518319.237754:0:17083:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789518319.237761:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789518319.237861:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+10:17069:x1876445522734208:12345-0@lo:256:mount.lustre.0 Request processed in 128us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.237869:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518319.237952:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734208:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789518319.238579:0:17069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518319.238604:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.238616:0:17069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518319.238624:0:17069:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e743f99c000 from 1 10000000:01000000:3.0:1789518319.238627:0:17069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518319.238659:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.238667:0:17069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.238691:0:17069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518319.238719:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518319.238754:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.239487:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74112519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518319.239575:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734336 00000100:00100000:0.0:1789518319.239582:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734336 00000100:00100000:2.0:1789518319.239653:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518319.239671:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+10:17069:x1876445522734336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518319.239685:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518319.239710:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423153c3 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.239734:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 11 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.239745:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 11 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.239753:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad000, rc 0) 00000100:00100000:2.0:1789518319.240237:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+11:17069:x1876445522734336:12345-0@lo:101:mount.lustre.0 Request processed in 567us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.240244:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518319.240333:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518319.240349:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518319.240357:0:17069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518319.240589:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518319.240623:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518319.240708:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e744172fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518319.241027:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734464 00000100:00100000:1.0:1789518319.241033:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734464 00000100:00100000:1.0:1789518319.241100:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518319.241109:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+11:17069:x1876445522734464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518319.241247:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+11:17069:x1876445522734464:12345-0@lo:501:mount.lustre.0 Request processed in 140us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518319.241256:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518319.241324:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518319.241355:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518319.241406:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518319.243074:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e744172fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.243156:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734592 00000100:00100000:2.0:1789518319.243163:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734592 00000100:00100000:3.0:1789518319.243345:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518319.243355:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+11:17069:x1876445522734592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518319.244014:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+11:17069:x1876445522734592:12345-0@lo:503:mount.lustre.0 Request processed in 659us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.244023:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518319.244102:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518319.244869:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17118:1876445522734720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.246664:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.246756:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7411251b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.247062:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734720 00000100:00100000:2.0:1789518319.247073:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734720 00000100:00100000:2.0:1789518319.247168:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518319.247179:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+11:17118:x1876445522734720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518319.248335:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+11:17118:x1876445522734720:12345-0@lo:502:llog_process_th.0 Request processed in 1148us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.248355:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518319.248488:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17118:1876445522734720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518319.248596:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518319.248607:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.248610:0:17118:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789518319.248618:0:17118:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e743f99c000 00000020:00000080:3.0:1789518319.248621:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518319.248629:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518319.248632:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.248633:0:17118:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789518319.248635:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518319.248638:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.248639:0:17118:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789518319.248651:0:17118:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e743f99c000 00000020:00000080:3.0:1789518319.248654:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518319.248734:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518319.248739:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.248740:0:17118:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789518319.248743:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518319.248745:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.248747:0:17118:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518319.248750:0:17118:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e743f99c000 00000020:00000080:3.0:1789518319.248752:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518319.248772:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518319.248775:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.248776:0:17118:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518319.248779:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518319.248781:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518319.248782:0:17118:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789518319.248786:0:17118:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e743f99c000 00000020:00000080:3.0:1789518319.248787:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518319.248835:0:17118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17118:1876445522734848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.255839:0:17118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.255895:0:17118:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7407d0b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518319.257022:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734848 00000100:00100000:0.0:1789518319.257035:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734848 00000100:00100000:0.0:1789518319.257098:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518319.257108:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+11:17118:x1876445522734848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518319.257276:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+11:17118:x1876445522734848:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518319.257284:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518319.258151:0:17118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17118:1876445522734848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518319.258215:0:17118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518319.258229:0:17118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518319.258232:0:17118:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789518319.258248:0:17118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789518319.258487:0:17069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789518319.258522:0:17069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518319.258543:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.258556:0:17069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518319.258627:0:17069:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789518319.258631:0:17069:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e743f99c000 10000000:01000000:2.0:1789518319.258636:0:17069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e743f99c000 10000000:01000000:2.0:1789518319.258642:0:17069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518319.258650:0:17069:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e743f99c000 from 1 10000000:01000000:2.0:1789518319.258653:0:17069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518319.258709:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad400/0x8d0fd679423153d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.258718:0:17069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ad400/0x8d0fd679423153d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.258730:0:17069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ad400/0x8d0fd679423153d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518319.258757:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518319.258837:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518319.258879:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.258908:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522734976 00000100:00100000:2.0:1789518319.258915:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522734976 00000100:00100000:2.0:1789518319.259809:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518319.259833:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+11:17069:x1876445522734976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518319.259875:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518319.259907:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ac400/0x8d0fd679423153d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423153d1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.259940:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ac400/0x8d0fd679423153d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423153d1 expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.259954:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ac400/0x8d0fd679423153d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423153d1 expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.259964:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac400, rc 0) 00000100:00100000:2.0:1789518319.260045:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+12:17069:x1876445522734976:12345-0@lo:101:mount.lustre.0 Request processed in 223us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.265988:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518319.266094:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522734976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518319.266119:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ad400/0x8d0fd679423153d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153d8 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518319.266131:0:17069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ad400/0x8d0fd679423153d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423153d8 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518319.266209:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522735104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518319.266258:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518319.266305:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730348c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518319.267460:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522735104 00000100:00100000:3.0:1789518319.267489:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522735104 00000100:00100000:3.0:1789518319.267619:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518319.267631:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17069:x1876445522735104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518319.269742:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17069:x1876445522735104:12345-0@lo:501:mount.lustre.0 Request processed in 2032us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.269759:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518319.270584:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522735104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518319.270644:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522735232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518319.271191:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518319.271247:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730348c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518319.271873:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522735232 00000100:00100000:3.0:1789518319.271883:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522735232 00000100:00100000:3.0:1789518319.273725:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518319.273740:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+12:17069:x1876445522735232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518319.273897:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+12:17069:x1876445522735232:12345-0@lo:503:mount.lustre.0 Request processed in 162us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.274009:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518319.274714:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522735232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518319.276622:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17123:1876445522735360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.276722:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.276767:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410f289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.277046:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522735360 00000100:00100000:2.0:1789518319.277053:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522735360 00000100:00100000:2.0:1789518319.277100:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518319.277109:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:17123:x1876445522735360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518319.277227:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:17123:x1876445522735360:12345-0@lo:502:llog_process_th.0 Request processed in 119us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518319.277235:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518319.277608:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17123:1876445522735360:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789518319.277742:0:17123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789518319.277758:0:17123:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e73034fcd40) 00000020:00000080:3.0:1789518319.277778:0:17123:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789518319.277870:0:17123:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e743f99c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789518319.277874:0:17123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e743f99c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789518319.277876:0:17123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e743f99c000 4 00010000:00080000:3.0:1789518319.279107:0:17123:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e730292a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518319.288097:0:17123:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789518319.288286:0:17123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789518319.288325:0:17123:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518319.288336:0:17123:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8d0fd679423153e6 00000100:00080000:3.0:1789518319.288346:0:17123:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518319.288358:0:17123:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e730292a800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518319.288390:0:17123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e91180 x1876445522735488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518319.288423:0:17123:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789518319.288782:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522735488:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518319.288853:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.291108:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522735488 00000100:00100000:1.0:1789518319.291122:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522735488 00000100:00100000:1.0:1789518319.291168:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518319.291175:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1876445522735488:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518319.291265:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1876445522735488:12345-0@lo:38:llog_process_th.0 Request processed in 89us (2411us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789518319.291272:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518319.291335:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518319.291343:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e730292a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518319.291348:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789518319.291352:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522735488:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518319.292086:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17123:1876445522735616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.292147:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.292178:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522735616 00000100:00100000:3.0:1789518319.292182:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522735616 00000100:00100000:3.0:1789518319.292212:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518319.292220:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17123:x1876445522735616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.292318:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17123:x1876445522735616:12345-0@lo:502:llog_process_th.0 Request processed in 98us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.292326:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518319.292370:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410f28780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518319.292386:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17123:1876445522735616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.292418:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17123:1876445522735744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.292447:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.292487:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522735744 00000100:00100000:3.0:1789518319.292491:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522735744 00000100:00100000:3.0:1789518319.293642:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518319.293654:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7419693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+12:17123:x1876445522735744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518319.294213:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7419693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+12:17123:x1876445522735744:12345-0@lo:502:llog_process_th.0 Request processed in 559us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.294220:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518319.294278:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410f28780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518319.294299:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6224dd85-753f-4c3f-83da-7a6019473f75:17123:1876445522735744:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789518319.294330:0:17123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789518319.294427:0:17069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789518319.294454:0:17069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518319.294489:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad400/0x8d0fd679423153d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153d8 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.294501:0:17069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ad400/0x8d0fd679423153d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153d8 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518319.294549:0:17069:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518319.294551:0:17069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518319.294552:0:17069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518319.294554:0:17069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518319.294555:0:17069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518319.294556:0:17069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518319.294557:0:17069:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518319.294559:0:17069:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518319.294560:0:17069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518319.294562:0:17069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518319.294565:0:17069:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789518319.294568:0:17069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518319.294569:0:17069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518319.294570:0:17069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518319.294571:0:17069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518319.294572:0:17069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518319.294573:0:17069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518319.294574:0:17069:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518319.294575:0:17069:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518319.294576:0:17069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518319.294577:0:17069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518319.294594:0:17069:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518319.294608:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522735872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518319.294642:0:17069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.294664:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303f8bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518319.294867:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522735872 00000100:00100000:3.0:1789518319.294874:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522735872 00000100:00100000:3.0:1789518319.295455:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518319.295507:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:17069:x1876445522735872:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518319.295531:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789518319.295543:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789518319.301057:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518319.301082:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789518319.302114:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:17069:x1876445522735872:12345-0@lo:253:mount.lustre.0 Request processed in 6613us (7465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.302129:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:1.0:1789518319.302221:0:17106:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518319.302227:0:17106:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518319.302248:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.302270:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 11 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.302279:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.302328:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 11 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.302344:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 11 pid: 17084 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518319.302357:0:17106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522736000:0@lo:104: 00000100:00100000:1.0:1789518319.302393:0:17106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.302424:0:17106:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303f8b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518319.303628:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17069:1876445522735872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518319.303644:0:17069:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789518319.303647:0:17069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518319.303648:0:17069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789518319.303650:0:17069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518319.303651:0:17069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518319.303652:0:17069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518319.303653:0:17069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518319.303654:0:17069:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789518319.303656:0:17069:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789518319.303658:0:17069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518319.303659:0:17069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789518319.303672:0:17069:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789518319.304160:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736000 00000100:00100000:1.0:1789518319.304169:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736000 00000100:00100000:1.0:1789518319.304209:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518319.304217:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522736000:12345-0@lo:104: 00010000:00010000:1.0:1789518319.304233:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.304302:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518319.304308:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522736000:12345-0@lo:104: Request processed in 92us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518319.304314:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518319.304345:0:17106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522736000:0@lo:104: 00010000:00010000:1.0:1789518319.304361:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305351:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518319.305361:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305370:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c2200 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518319.305374:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305383:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518319.305390:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518319.305396:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518319.305430:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305435:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518319.305456:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305477:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c2200/0x8d0fd679423153b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153bc expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305562:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518319.305565:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518319.305569:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518319.305605:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522736128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518319.305649:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.305735:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736128 00000100:00100000:3.0:1789518319.305741:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736128 00010000:00010000:3.0:1789518319.305763:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 12 pid: 17084 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518319.305787:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518319.305794:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+12:3637:x1876445522736128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518319.305806:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518319.305811:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 12 pid: 17084 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305821:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 12 pid: 17084 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305833:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423153bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423153b5 expref: 12 pid: 17084 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305847:0:17075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.305854:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789518319.305867:0:17075:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003641662s 00010000:00010000:3.0:1789518319.306063:0:17075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.306070:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.306076:0:17075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.306082:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.306087:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518319.306091:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.306098:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.306112:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518319.306121:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518319.306262:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+11:3637:x1876445522736128:12345-0@lo:103:ldlm_bl.0 Request processed in 468us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.306270:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518319.306322:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522736128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518319.306635:0:17106:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.306644:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.306650:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0da00/0x8d0fd679423153ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789518319.331419:0:17069:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789518319.332835:0:17069:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789518319.333240:0:17129:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789518319.333245:0:17129:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789518319.333635:0:17130:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789518319.334214:0:17069:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789518319.334619:0:17131:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8e743f93bb80 x1876445522736256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518319.334632:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000040:00080000:1.0:1789518319.335008:0:17130:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789518319.336262:0:17069:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789518319.336302:0:17069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789518319.336664:0:17069:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789518319.336671:0:17069:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789518319.336719:0:17069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518319.338877:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789518319.338986:0:17130:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789518319.340030:0:17069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789518319.340567:0:17069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789518319.340603:0:17069:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789518319.343761:0:17069:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789518319.353285:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789518319.355144:0:17069:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789518319.355203:0:17069:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9964198f988 00100000:10000000:3.0:1789518319.355213:0:17069:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789518319.355871:0:17069:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518319.355898:0:17069:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518319.355928:0:17069:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789518319.355951:0:17069:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789518319.358648:0:17069:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518319.359764:0:17069:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789518319.797912:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789518320.054824:0:17087:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789518320.054837:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e743f99c000 from 7 10000000:01000000:1.0:1789518320.054846:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789518320.054910:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518320.054926:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518320.054941:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518320.054994:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522736384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518320.055090:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518320.055256:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518320.055910:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736384 00000100:00100000:0.0:1789518320.055922:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736384 00000100:00100000:0.0:1789518320.056005:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518320.056026:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+11:17087:x1876445522736384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518320.056046:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518320.056067:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423153f4 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518320.056098:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518320.056119:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518320.056129:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7e00, rc 0) 00000100:00100000:0.0:1789518320.056421:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17087:x1876445522736384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 397us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518320.056439:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789518320.056772:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522736384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518320.056801:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518320.056813:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518320.056911:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522736512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789518320.056966:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518320.057023:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409ec8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518320.057127:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736512 00000100:00100000:0.0:1789518320.057134:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736512 00000100:00100000:0.0:1789518320.057418:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789518320.057429:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:17087:x1876445522736512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518320.057449:0:17082:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518320.057683:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518320.057696:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789518320.058278:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:17087:x1876445522736512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 847us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518320.058744:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522736512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789518320.058819:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518320.058831:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518320.058844:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518320.059136:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:3.0:1789518320.314413:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789518320.379933:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:0.0:1789518320.824100:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518321.334375:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789518321.400225:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:1.0:1789518321.847222:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518322.423896:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:3.0:1789518322.872746:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518323.445557:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000001:02000400:1.0:1789518323.830721:0:17374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789518323.895000:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518324.469898:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000100:00080000:3.0:1789518324.726829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789518324.726837:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789518324.726840:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518324.726848:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1789518324.726855:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789518324.726866:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e74416ed000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518324.726892:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e91180 x1876445522736768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518324.726907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518324.726919:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518324.726922:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518324.726924:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518324.726927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789518324.726929:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789518324.726931:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e730292a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518324.726938:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e730292a800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518324.726951:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e90000 x1876445522736896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518324.726978:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518324.727038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522736640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518324.727124:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518324.727393:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522736768:0@lo:38:kworker.0 00000100:00100000:1.0:1789518324.727451:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518324.727503:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522736896:0@lo:38:kworker.0 00000100:00100000:1.0:1789518324.727527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518324.727571:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736640 00000100:00100000:1.0:1789518324.727579:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736640 00000100:00100000:1.0:1789518324.727640:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518324.727661:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+12:3637:x1876445522736640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518324.727711:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+12:3637:x1876445522736640:12345-0@lo:400:kworker.0 Request processed in 52us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518324.727728:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518324.727775:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522736640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518324.728539:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736768 00000100:00100000:3.0:1789518324.728548:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736768 00000100:00100000:3.0:1789518324.728581:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518324.728587:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1876445522736768:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789518324.728606:0:17096:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789518324.729943:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736896 00000100:00100000:0.0:1789518324.729955:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736896 00000100:00100000:0.0:1789518324.729986:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518324.729992:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1876445522736896:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789518324.730018:0:17092:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1789518324.730056:0:17092:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8d0fd67942315402 00000004:00100000:0.0:1789518324.730073:0:17092:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518324.730205:0:17092:0:(import.c:65:import_set_state_nolock()) ffff8e740571a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518324.730283:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876445522736896:12345-0@lo:38:kworker.0 Request processed in 290us (2754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518324.730291:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789518324.730446:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e7435e90000 x1876445522736896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518324.730516:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789518324.730526:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789518324.730531:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518324.730533:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e730292a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518324.730539:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876445522736896:0@lo:38:kworker.0 00000100:00100000:3.0:1789518324.773199:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1876445522736768:12345-0@lo:38:kworker.0 Request processed in 44603us (45739us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518324.773216:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789518324.773291:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518324.773297:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518324.773301:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522736768:0@lo:38:kworker.0 00000020:00000004:1.0:1789518324.807189:0:17426:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789518324.807369:0:17426:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789518324.922739:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518325.495338:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000020:00000004:3.0:1789518325.695076:0:17476:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518325.695275:0:17476:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789518325.941720:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518326.517523:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:1.0:1789518326.965652:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518327.542345:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:1.0:1789518327.991436:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518328.566053:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:1.0:1789518329.016403:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518329.592325:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000100:00100000:1.0:1789518329.847575:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518319/real 1789518319] req@ffff8e73033da300 x1876445522733824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518329 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518329.847616:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e73033da300 x1876445522733824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518329 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518329.847628:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518319/real 1789518319] req@ffff8e7435e92d80 x1876445522733440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518329 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518329.847642:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7435e92d80 x1876445522733440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518329 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518329.847671:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518329.847685:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518329.847690:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733824:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789518329.847696:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416e4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518329.847700:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518329.847703:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522733440:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789518329.856962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789518329.856969:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789518329.856973:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518329.856982:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:2.0:1789518329.856987:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789518329.856999:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e74416ed000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518329.857023:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033dad80 x1876445522737152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518329.857045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518329.857048:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789518329.857051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e74416e4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518329.857054:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1789518329.857056:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789518329.857060:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e74416e4800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518329.857071:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033db480 x1876445522737280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518329.857091:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518329.857093:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789518329.857095:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518329.857098:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1789518329.857101:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789518329.857105:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7402e82000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518329.857117:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033d8700 x1876445522737408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518329.857848:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522737152:0@lo:38:kworker.0 00000100:00100000:1.0:1789518329.857938:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518329.857986:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522737280:0@lo:8:kworker.0 00000400:00000100:1.0:1789518329.858005:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522737280 offset 0 length 520: 4 00000100:00100000:1.0:1789518329.858024:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522737408:0@lo:8:kworker.0 00000400:00000100:1.0:1789518329.858042:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522737408 offset 0 length 520: 4 00000100:00100000:1.0:1789518329.858077:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522737152 00000100:00100000:1.0:1789518329.858086:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522737152 00000100:00100000:1.0:1789518329.858121:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518329.858129:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1876445522737152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789518329.858148:0:17095:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789518329.864692:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522737024:0@lo:400:kworker.0 00000100:00100000:2.0:1789518329.864765:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518329.864814:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518329.864821:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522737536:0@lo:400:kworker.0 00000100:00100000:2.0:1789518329.864850:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518329.865172:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522737024 00000100:00100000:0.0:1789518329.865181:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522737024 00000100:00100000:0.0:1789518329.865260:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518329.865268:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:3639:x1876445522737024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518329.865322:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+12:3639:x1876445522737024:12345-0@lo:400:kworker.0 Request processed in 55us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518329.865328:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518329.865368:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522737024:0@lo:400:kworker.0 00000100:00100000:1.0:1789518329.882991:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1876445522737152:12345-0@lo:38:kworker.0 Request processed in 24852us (25044us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789518329.883005:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789518329.888460:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518329.888488:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789518329.888494:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522737152:0@lo:38:kworker.0 00000100:00100000:3.0:1789518329.889379:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522737536 00000100:00100000:3.0:1789518329.889389:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522737536 00000100:00100000:3.0:1789518329.889439:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518329.889449:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522737536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518329.889560:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522737536:12345-0@lo:400:kworker.0 Request processed in 114us (24708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518329.889568:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789518329.889618:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e73033da680 x1876445522737536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518329.889632:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522737536:0@lo:400:kworker.0 00010000:00010000:3.0:1789518330.037624:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518330.617913:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:1.0:1789518331.069382:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518331.579160:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789518331.638417:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:3.0:1789518332.085686:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789518332.303691:0:17821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789518332.303695:0:17821:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789518332.303697:0:17821:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789518332.303807:0:17821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e7303537800 00000020:01000004:2.0:1789518332.303821:0:17821:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789518332.303833:0:17821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789518332.303847:0:17821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8e743cdd4d40) 00000020:00000080:2.0:1789518332.303860:0:17821:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789518332.408907:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789518332.409202:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789518332.413166:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789518332.414930:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.415393:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.415726:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.416316:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789518332.416617:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789518332.419352:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789518332.420795:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.422141:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789518332.422899:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.423414:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.423959:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789518332.425620:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789518332.426811:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.428432:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.431459:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789518332.435336:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.437979:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.440081:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789518332.443455:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789518332.444370:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789518332.444776:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789518332.445452:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.447719:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.449052:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.449449:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.450321:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.454151:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.454639:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789518332.454898:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789518332.455145:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789518332.455508:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789518332.455974:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789518332.457694:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789518332.460685:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789518332.461199:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789518332.461684:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789518332.461897:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789518332.463284:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789518332.463786:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789518332.464043:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789518332.464268:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789518332.464569:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789518332.464820:0:17821:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:01000000:3.0:1789518332.466674:0:17821:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789518332.466886:0:17821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789518332.466897:0:17821:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789518332.466910:0:17821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942315410 00000020:01000004:3.0:1789518332.466918:0:17821:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789518332.466941:0:17821:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789518332.466945:0:17821:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789518332.466951:0:17821:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789518332.466977:0:17821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789518332.466981:0:17821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789518332.478656:0:17821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789518332.478699:0:17821:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.143@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789518332.478704:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789518332.478706:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789518332.478707:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518332.478709:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518332.478710:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518332.478711:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518332.478712:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518332.478714:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518332.478716:0:17821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518332.478720:0:17821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789518332.478722:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518332.478723:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789518332.478724:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518332.478725:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518332.478726:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518332.478727:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518332.478728:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518332.478729:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518332.478730:0:17821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518332.478755:0:17821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789518332.478775:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522737664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789518332.478850:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.478967:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.479020:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522737664 00000100:00100000:1.0:1789518332.479029:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522737664 00000100:00100000:1.0:1789518332.479109:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789518332.479119:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17821:x1876445522737664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518332.479148:0:17084:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789518332.479151:0:17084:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789518332.479159:0:17084:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789518332.479606:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17821:x1876445522737664:12345-0@lo:253:mount.lustre.0 Request processed in 487us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.479613:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518332.479716:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522737664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518332.479728:0:17821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789518332.479730:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518332.479732:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789518332.479734:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518332.479735:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518332.479736:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518332.479737:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518332.479738:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789518332.479740:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518332.479741:0:17821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789518332.479766:0:17821:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e7303537800 from lustre-MDT0001 10000000:01000000:2.0:1789518332.479807:0:17821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789518332.479815:0:17821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789518332.479822:0:17821:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e73030e99c0 local copy 00010000:00010000:2.0:1789518332.479832:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518332.479914:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522737792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518332.479942:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.480008:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.480054:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522737792 00000100:00100000:1.0:1789518332.480059:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522737792 00000100:00100000:1.0:1789518332.480092:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518332.480099:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17821:x1876445522737792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518332.480171:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17821:x1876445522737792:12345-0@lo:501:mount.lustre.0 Request processed in 73us (228us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518332.480179:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518332.480303:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522737792:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789518332.480329:0:17821:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789518332.480344:0:17821:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789518332.480350:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.480359:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518332.480384:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e7303537800 10000000:01000000:2.0:1789518332.480388:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789518332.480393:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e73030e99c0 10000000:01000000:2.0:1789518332.480395:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789518332.480398:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e73030e99c0 from 1 10000000:01000000:2.0:1789518332.480401:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789518332.480421:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ace00/0x8d0fd67942315417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.480428:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ace00/0x8d0fd67942315417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.480451:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ace00/0x8d0fd67942315417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518332.480496:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522737920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518332.480524:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.480545:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.480756:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522737920 00000100:00100000:1.0:1789518332.480761:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522737920 00000100:00100000:1.0:1789518332.480793:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518332.480800:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+12:17821:x1876445522737920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518332.480808:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518332.480820:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231541e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315417 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518332.480840:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231541e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315417 expref: 13 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518332.480862:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0cc00/0x8d0fd6794231541e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315417 expref: 13 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518332.480871:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0cc00, rc 0) 00000100:00100000:1.0:1789518332.480910:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+13:17821:x1876445522737920:12345-0@lo:101:mount.lustre.0 Request processed in 111us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.480916:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518332.481021:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522737920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518332.481034:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ace00/0x8d0fd67942315417 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231541e expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481042:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ace00/0x8d0fd67942315417 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231541e expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518332.481056:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789518332.481075:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ace00/0x8d0fd67942315417 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231541e expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481083:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ace00/0x8d0fd67942315417 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231541e expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518332.481091:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e7303537800 10000000:01000000:2.0:1789518332.481095:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789518332.481099:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e7303537800 from 1 10000000:01000000:2.0:1789518332.481101:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789518332.481116:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ac000/0x8d0fd67942315425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481123:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ac000/0x8d0fd67942315425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481136:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ac000/0x8d0fd67942315425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518332.481148:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518332.481174:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.481203:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391900 going to sleep for 11 seconds 00000100:00100000:0.0:1789518332.481254:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738048 00000100:00100000:0.0:1789518332.481258:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738048 00000100:00100000:0.0:1789518332.481291:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518332.481298:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+13:17821:x1876445522738048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518332.481314:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518332.481323:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7c00/0x8d0fd6794231542c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315425 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.481337:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7c00/0x8d0fd6794231542c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315425 expref: 14 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.481345:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7c00/0x8d0fd6794231542c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315425 expref: 14 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.481352:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7c00, rc 0) 00000100:00100000:0.0:1789518332.481382:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+14:17821:x1876445522738048:12345-0@lo:101:mount.lustre.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.481388:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518332.481634:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518332.481645:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ac000/0x8d0fd67942315425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231542c expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481653:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ac000/0x8d0fd67942315425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231542c expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518332.481663:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789518332.481667:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ac000/0x8d0fd67942315425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231542c expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481673:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ac000/0x8d0fd67942315425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231542c expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518332.481679:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789518332.481683:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518332.481687:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e7303537800 10000000:01000000:2.0:1789518332.481690:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789518332.481693:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789518332.481695:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789518332.481710:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad200/0x8d0fd67942315433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481733:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ad200/0x8d0fd67942315433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.481740:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ad200/0x8d0fd67942315433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518332.481752:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518332.481777:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.481796:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391900 going to sleep for 11 seconds 00000100:00100000:0.0:1789518332.481836:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738176 00000100:00100000:0.0:1789518332.481840:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738176 00000100:00100000:0.0:1789518332.481865:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518332.481871:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+14:17821:x1876445522738176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518332.481877:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518332.481884:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b6600/0x8d0fd6794231543a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315433 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.481897:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b6600/0x8d0fd6794231543a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315433 expref: 15 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.481905:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b6600/0x8d0fd6794231543a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315433 expref: 15 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.481919:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6600, rc 0) 00000100:00100000:0.0:1789518332.481943:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738176:12345-0@lo:101:mount.lustre.0 Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.481948:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518332.484806:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518332.484837:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ad200/0x8d0fd67942315433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231543a expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.484851:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ad200/0x8d0fd67942315433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231543a expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518332.490004:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789518332.491026:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518332.498256:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789518332.501387:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789518332.501453:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789518332.501489:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789518332.501505:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789518332.501675:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789518332.501690:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789518332.501707:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789518332.501725:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789518332.501741:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789518332.501755:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789518332.501770:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789518332.501783:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789518332.501810:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789518332.501827:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789518332.501844:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1789518332.501858:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789518332.501873:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789518332.501889:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1789518332.501905:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789518332.501921:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789518332.501937:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789518332.501952:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789518332.501986:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1789518332.501992:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1789518332.502107:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518332.502187:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.502296:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.503215:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738304 00000100:00100000:1.0:1789518332.503225:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738304 00000100:00100000:1.0:1789518332.503389:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789518332.503399:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518332.503601:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738304:12345-0@lo:501:mount.lustre.0 Request processed in 204us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.503609:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518332.503698:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518332.503745:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518332.503804:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.503996:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518332.508966:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738432 00000100:00100000:2.0:1789518332.508982:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738432 00000100:00100000:1.0:1789518332.509256:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518332.509269:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738432:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518332.510362:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738432:12345-0@lo:503:mount.lustre.0 Request processed in 1092us (6564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.510374:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518332.510706:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738432:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789518332.511287:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789518332.511377:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518332.511435:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.511749:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.511887:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738560 00000100:00100000:1.0:1789518332.511895:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738560 00000100:00100000:1.0:1789518332.511940:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518332.511948:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518332.513495:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738560:12345-0@lo:502:mount.lustre.0 Request processed in 1512us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518332.513507:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518332.513883:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518332.514141:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789518332.514173:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789518332.514394:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789518332.514407:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789518332.514419:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789518332.514431:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789518332.514444:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789518332.514457:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789518332.514627:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789518332.514644:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789518332.514657:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789518332.514669:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789518332.514683:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789518332.514715:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789518332.514732:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789518332.514755:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789518332.514770:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789518332.514783:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789518332.514919:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789518332.514942:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789518332.514955:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789518332.514968:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789518332.514980:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789518332.514995:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789518332.515008:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789518332.515021:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789518332.515035:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789518332.515050:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789518332.515063:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789518332.515090:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789518332.515103:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789518332.515114:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789518332.515125:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789518332.515136:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789518332.515148:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789518332.515160:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789518332.515171:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789518332.515184:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789518332.515197:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789518332.515210:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789518332.515222:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789518332.515236:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789518332.515358:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789518332.515373:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789518332.515417:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518332.515703:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.515811:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.515936:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738688 00000100:00100000:1.0:1789518332.515945:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738688 00000100:00100000:1.0:1789518332.516056:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518332.516066:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518332.516188:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522738688:12345-0@lo:502:mount.lustre.0 Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.516195:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518332.516275:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522738688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518332.516328:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789518332.516336:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789518332.517393:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.517405:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.517407:0:17825:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789518332.517413:0:17825:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789518332.517415:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518332.517429:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8e7303203380) 00000020:00000080:0.0:1789518332.517450:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789518332.517456:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789518332.517669:0:17825:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789518332.517677:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942315448 00000020:00000080:0.0:1789518332.517979:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789518332.517984:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.517988:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.517989:0:17825:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789518332.517992:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.517995:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.517996:0:17825:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789518332.517999:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518332.518006:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8e7303204d40) 00000020:00000080:0.0:1789518332.518018:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789518332.518022:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789518332.518024:0:17825:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789518332.518027:0:17825:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789518332.518034:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518332.518088:0:17825:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7303537800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789518332.518100:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8e7303200000) 00000020:00000080:0.0:1789518332.518110:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789518332.518174:0:17825:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789518332.518179:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd6794231545d 00000020:00000080:0.0:1789518332.518347:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789518332.518354:0:17825:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789518332.518358:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8d0fd67942315464 00080000:01000000:0.0:1789518332.518364:0:17825:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789518332.518366:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd6794231546b 00010000:00010000:2.0:1789518332.603850:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789518332.605345:0:17825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789518332.607254:0:17825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789518332.612001:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789518332.612017:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518332.612025:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518332.612027:0:17825:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789518332.612032:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518332.612037:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518332.612045:0:17825:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789518332.612049:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518332.612053:0:17825:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:00000080:3.0:1789518332.612082:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518332.612100:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8e743b2519c0) 00000020:00000080:3.0:1789518332.612122:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789518332.612127:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518332.612208:0:17825:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789518332.612215:0:17825:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789518332.612222:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd67942315479 00010000:00080000:3.0:1789518332.612252:0:17825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7421480000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518332.613899:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789518332.625920:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789518332.625936:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789518332.625984:0:17825:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789518332.626008:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd67942315480 00000100:00080000:1.0:1789518332.626019:0:17825:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518332.626031:0:17825:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e7421480000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518332.626071:0:17825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f93ad80 x1876445522738816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518332.626100:0:17825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789518332.626153:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518332.626156:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518332.626158:0:17825:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789518332.626161:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789518332.626164:0:17825:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789518332.626166:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518332.626167:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518332.626169:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789518332.626171:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518332.626172:0:17825:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789518332.626175:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518332.626179:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518332.626180:0:17825:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789518332.626184:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789518332.626213:0:17825:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789518332.626223:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518332.626251:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518332.626253:0:17825:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789518332.626257:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789518332.626259:0:17825:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789518332.626261:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518332.626262:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518332.626264:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789518332.626267:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518332.626268:0:17825:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789518332.626270:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518332.626273:0:17825:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789518332.626277:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518332.626278:0:17825:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789518332.626281:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789518332.626285:0:17825:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:1.0:1789518332.626306:0:17825:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789518332.626309:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518332.626321:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e7302ac0000) 00000020:00000080:1.0:1789518332.626332:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789518332.626337:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789518332.626394:0:17825:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789518332.626400:0:17825:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789518332.626405:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd6794231548e 00010000:00080000:1.0:1789518332.626432:0:17825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e743f88c000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789518332.626806:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1789518332.627187:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522738816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789518332.627271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.627374:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738816 00000100:00100000:2.0:1789518332.627381:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738816 00000100:00100000:2.0:1789518332.627413:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518332.627420:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1876445522738816:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789518332.627444:0:17096:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1789518332.627488:0:17096:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd67942315495 00000004:00100000:2.0:1789518332.627502:0:17096:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789518332.627508:0:17096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789518332.627877:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789518332.627882:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789518332.627885:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518332.627891:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:1.0:1789518332.627894:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789518332.627902:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e74416ed000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518332.627932:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f93b100 x1876445522738944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518332.627950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518332.627954:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789518332.627957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518332.627960:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518332.627996:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522739072:0@lo:400:kworker.0 00000100:00100000:1.0:1789518332.628032:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518332.628067:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522739072 00000100:00100000:1.0:1789518332.628072:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522739072 00000100:00100000:1.0:1789518332.628102:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518332.628108:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522739072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518332.628152:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522739072:12345-0@lo:400:kworker.0 Request processed in 44us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.628159:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789518332.628194:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e743f938000 x1876445522739072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518332.628206:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522739072:0@lo:400:kworker.0 00000100:00100000:1.0:1789518332.630711:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522738944:0@lo:38:kworker.0 00000100:00100000:1.0:1789518332.630810:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518332.630865:0:17095:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789518332.630875:0:17095:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:2.0:1789518332.632359:0:17825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789518332.632757:0:17825:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789518332.636523:0:17825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518332.637663:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522738944 00000100:00100000:1.0:1789518332.637675:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522738944 00000100:00100000:2.0:1789518332.638317:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518332.638326:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1876445522738944:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789518332.638423:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1876445522738944:12345-0@lo:38:kworker.0 Request processed in 96us (7614us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789518332.638430:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:0.0:1789518332.638625:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789518332.638785:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1789518332.639209:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518332.639225:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518332.639230:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789518332.639240:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522738944:0@lo:38:kworker.0 00000100:00080000:2.0:1789518332.639764:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8e740d7b3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518332.639845:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876445522738816:12345-0@lo:38:llog_process_th.0 Request processed in 12423us (12573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518332.639856:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518332.639933:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518332.639941:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789518332.639949:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789518332.639954:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518332.639956:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7421480000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518332.639973:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522738816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518332.640092:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518332.640106:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522739200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518332.640149:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789518332.640347:0:17831:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789518332.640351:0:17831:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789518332.640786:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522739200 00000100:00100000:2.0:1789518332.640795:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522739200 00000100:00100000:2.0:1789518332.640831:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518332.640840:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876445522739200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518332.640870:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789518332.640955:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876445522739200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518332.640970:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518332.641142:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522739200:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1789518332.641884:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789518332.641896:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789518332.641939:0:17825:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789518332.641960:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd6794231549c 00000100:00080000:0.0:1789518332.641968:0:17825:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518332.641976:0:17825:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e743f88c000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518332.642003:0:17825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d1c00 x1876445522739328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518332.642034:0:17825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789518332.642091:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.642095:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.642097:0:17825:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789518332.642099:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789518332.642103:0:17825:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789518332.642104:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518332.642105:0:17825:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518332.642107:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789518332.642109:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.642110:0:17825:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789518332.642112:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518332.642116:0:17825:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789518332.642119:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.642120:0:17825:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789518332.642123:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789518332.642127:0:17825:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:0.0:1789518332.642156:0:17825:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789518332.642158:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518332.642170:0:17825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e73032019c0) 00000020:00000080:0.0:1789518332.642181:0:17825:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789518332.642185:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:3.0:1789518332.642568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518332.642743:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518332.642745:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518332.642748:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518332.642844:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522739328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789518332.642893:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522739328 offset 0 length 520: 4 00000004:00080000:0.0:1789518332.643311:0:17825:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789518332.643319:0:17825:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789518332.643327:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8d0fd679423154aa 00010000:00080000:0.0:1789518332.643357:0:17825:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7409e2b000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789518332.643637:0:17825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789518332.643709:0:17825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789518332.643725:0:17825:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789518332.646230:0:17825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518332.646709:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789518332.646831:0:17825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789518332.647545:0:17833:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789518332.647551:0:17833:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789518332.648714:0:17825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789518332.648728:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789518332.648773:0:17825:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789518332.648797:0:17825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd679423154b1 00000100:00080000:0.0:1789518332.648807:0:17825:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518332.648818:0:17825:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7409e2b000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518332.648854:0:17825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d2d80 x1876445522739456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518332.648917:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522739456:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789518332.648972:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522739456 offset 0 length 520: 4 00000100:00080000:0.0:1789518332.649024:0:17825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789518332.649082:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.649086:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.649088:0:17825:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789518332.649091:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.649094:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.649096:0:17825:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518332.649106:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518332.649108:0:17825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789518332.649110:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.649113:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.649114:0:17825:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789518332.649116:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.649119:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.649120:0:17825:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518332.649124:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789518332.649151:0:17825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.649154:0:17825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.649155:0:17825:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518332.649158:0:17825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789518332.649293:0:17821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789518332.649326:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789518332.649341:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad200/0x8d0fd67942315433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231543a expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.649352:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ad200/0x8d0fd67942315433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231543a expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518332.649373:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7303537800 from 1 10000000:01000000:0.0:1789518332.649376:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518332.649402:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.649410:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.649421:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.649436:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518332.649507:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.649529:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518332.649548:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522739584 00000100:00100000:0.0:1789518332.649555:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522739584 00000100:00100000:0.0:1789518332.649604:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518332.649612:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+15:17821:x1876445522739584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518332.649626:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518332.649637:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423154b8 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.649658:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 16 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.649667:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 16 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.649675:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6c00, rc 0) 00000100:00100000:0.0:1789518332.649710:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+16:17821:x1876445522739584:12345-0@lo:101:mount.lustre.0 Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.649717:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518332.649760:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518332.649774:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.649782:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.650313:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739712:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789518332.655288:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.655335:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518332.655552:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522739712 00000100:00100000:3.0:1789518332.655562:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522739712 00000100:00100000:3.0:1789518332.655624:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518332.655633:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+16:17821:x1876445522739712:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789518332.655656:0:17083:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789518332.655684:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789518332.655687:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789518332.655797:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+16:17821:x1876445522739712:12345-0@lo:256:mount.lustre.0 Request processed in 165us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518332.655805:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789518332.655852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518332.655856:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518332.655859:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518332.655862:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789518332.656113:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739712:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789518332.656734:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518332.656746:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.656759:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518332.656767:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7303537800 from 1 10000000:01000000:0.0:1789518332.656770:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518332.656801:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.656810:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.656820:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.656839:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518332.656876:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.656910:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518332.657156:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522739840 00000100:00100000:3.0:1789518332.657163:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522739840 00000100:00100000:3.0:1789518332.657206:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518332.657214:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+16:17821:x1876445522739840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518332.657226:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518332.657248:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423154c6 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518332.657271:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518332.657282:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518332.657291:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e74421c3200, rc 0) 00000100:00100000:3.0:1789518332.657339:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522739840:12345-0@lo:101:mount.lustre.0 Request processed in 126us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518332.657346:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518332.657449:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518332.657488:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.657498:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518332.657657:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518332.657690:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518332.657718:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.657742:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7420eca600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518332.657922:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522739968 00000100:00100000:3.0:1789518332.657927:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522739968 00000100:00100000:3.0:1789518332.657947:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518332.657953:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522739968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518332.658028:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522739968:12345-0@lo:501:mount.lustre.0 Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518332.658035:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789518332.658108:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522739968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518332.658137:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518332.658175:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.658200:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7420eca600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518332.658254:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740096 00000100:00100000:3.0:1789518332.658259:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740096 00000100:00100000:3.0:1789518332.658276:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518332.658282:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522740096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518332.658833:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789518332.659194:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518332.659277:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518332.659361:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522740096:12345-0@lo:503:mount.lustre.0 Request processed in 1077us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518332.659370:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789518332.659542:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.659655:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7403904e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.659753:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740224 00000100:00100000:1.0:1789518332.659759:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740224 00000100:00100000:1.0:1789518332.659785:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518332.659794:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522740224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518332.659899:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522740224:12345-0@lo:502:mount.lustre.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.659906:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518332.660073:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518332.660341:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789518332.660367:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1789518332.660381:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1789518332.660394:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1789518332.660405:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1789518332.660421:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1789518332.660434:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1789518332.660447:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1789518332.660459:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789518332.661383:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1789518332.661396:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1789518332.661430:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518332.661504:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518332.661532:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518332.661623:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740352 00000100:00100000:0.0:1789518332.661631:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740352 00000100:00100000:0.0:1789518332.661681:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518332.661689:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522740352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518332.661807:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522740352:12345-0@lo:502:mount.lustre.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.661815:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518332.661871:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518332.661917:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789518332.661925:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789518332.662159:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.662167:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662170:0:17835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518332.662178:0:17835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7303537800 00000020:00000080:0.0:1789518332.662180:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518332.662187:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.662190:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662191:0:17835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789518332.662194:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.662196:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662197:0:17835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518332.662200:0:17835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e7303537800 00000020:00000080:0.0:1789518332.662202:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518332.662261:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.662264:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662265:0:17835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789518332.662267:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.662270:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662271:0:17835:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518332.662274:0:17835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7303537800 00000020:00000080:0.0:1789518332.662276:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518332.662290:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.662292:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662293:0:17835:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518332.662295:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518332.662303:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662304:0:17835:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789518332.662308:0:17835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e7303537800 00000020:00000080:0.0:1789518332.662310:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518332.662329:0:17835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518332.662331:0:17835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518332.662332:0:17835:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789518332.662335:0:17835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789518332.662379:0:17821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789518332.662401:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518332.662412:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.662423:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518332.662485:0:17821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789518332.662488:0:17821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e7303537800 10000000:01000000:0.0:1789518332.662490:0:17821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e7303537800 10000000:01000000:0.0:1789518332.662494:0:17821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518332.662498:0:17821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e7303537800 from 1 10000000:01000000:0.0:1789518332.662501:0:17821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518332.662524:0:17821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6a00/0x8d0fd679423154d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.662533:0:17821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6a00/0x8d0fd679423154d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.662542:0:17821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6a00/0x8d0fd679423154d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.662556:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518332.662604:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.662620:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518332.662636:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740480 00000100:00100000:0.0:1789518332.662641:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740480 00000100:00100000:0.0:1789518332.662662:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518332.662667:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+17:17821:x1876445522740480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518332.662677:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518332.662689:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7000/0x8d0fd679423154db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423154d4 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.662709:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7000/0x8d0fd679423154db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423154d4 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.662719:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7000/0x8d0fd679423154db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423154d4 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.662727:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7000, rc 0) 00000100:00100000:0.0:1789518332.662752:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740480:12345-0@lo:101:mount.lustre.0 Request processed in 85us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.662758:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518332.662793:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518332.662805:0:17821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6a00/0x8d0fd679423154d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154db expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.662814:0:17821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6a00/0x8d0fd679423154d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423154db expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.667064:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000040:00080000:0.0:1789518332.671209:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789518332.671766:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518332.671966:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789518332.671990:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789518332.672003:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789518332.672016:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789518332.672029:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789518332.672042:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789518332.672054:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789518332.672068:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789518332.672080:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789518332.672092:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789518332.672104:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789518332.672118:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789518332.672130:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789518332.672142:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789518332.672154:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789518332.672165:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789518332.672178:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789518332.672190:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789518332.672203:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789518332.672216:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789518332.672230:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789518332.672323:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789518332.672339:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789518332.672356:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789518332.674208:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789518332.675346:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789518332.675398:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789518332.675416:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789518332.675444:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789518332.675449:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789518332.679203:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518332.682040:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518332.682090:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518332.682115:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740608 00000100:00100000:3.0:1789518332.682124:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740608 00000100:00100000:3.0:1789518332.682175:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518332.682183:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518332.682319:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740608:12345-0@lo:501:mount.lustre.0 Request processed in 136us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518332.682328:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518332.682393:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518332.682450:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518332.682516:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518332.682545:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.683671:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740736 00000100:00100000:1.0:1789518332.683683:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740736 00000100:00100000:1.0:1789518332.683732:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518332.683742:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518332.683865:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740736:12345-0@lo:503:mount.lustre.0 Request processed in 125us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.683872:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518332.683923:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518332.684334:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518332.684405:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518332.684439:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518332.684485:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.684498:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740864 00000100:00100000:1.0:1789518332.684502:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740864 00000100:00100000:1.0:1789518332.684518:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789518332.684524:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518332.684610:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740864:12345-0@lo:502:mount.lustre.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.684617:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789518332.684650:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518332.684809:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789518332.684830:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789518332.684841:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789518332.684852:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789518332.684862:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789518332.684873:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789518332.684883:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789518332.684893:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789518332.684903:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789518332.684914:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789518332.684925:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789518332.684943:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789518332.684953:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789518332.684973:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789518332.684984:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789518332.684995:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789518332.685005:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789518332.685016:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789518332.685026:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789518332.685036:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789518332.685046:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789518332.685057:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789518332.685067:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789518332.685078:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789518332.685089:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789518332.685099:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789518332.685110:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789518332.685120:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789518332.685130:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789518332.685148:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789518332.685159:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789518332.685169:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789518332.685179:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789518332.685191:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789518332.685203:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789518332.685214:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789518332.685224:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789518332.685234:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789518332.685244:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789518332.685254:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789518332.685264:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789518332.685274:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789518332.685284:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789518332.685294:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789518332.685313:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789518332.685331:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789518332.685343:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789518332.685354:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789518332.685382:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518332.685413:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518332.685429:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.685444:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522740992 00000100:00100000:1.0:1789518332.685448:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522740992 00000100:00100000:1.0:1789518332.685487:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789518332.685493:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518332.685559:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522740992:12345-0@lo:502:mount.lustre.0 Request processed in 65us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.685565:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789518332.688861:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522740992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518332.689073:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789518332.689103:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789518332.689140:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522741120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518332.689206:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.689689:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522741120 00000100:00100000:0.0:1789518332.689697:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522741120 00000100:00100000:0.0:1789518332.689744:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518332.689753:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522741120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518332.689873:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522741120:12345-0@lo:502:mount.lustre.0 Request processed in 121us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.689882:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789518332.693675:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435fc2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.693722:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522741120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518332.693827:0:17821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789518332.693842:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789518332.708884:0:17839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789518332.708901:0:17839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8e743cdd0000) 00000020:00000080:2.0:1789518332.708923:0:17839:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789518332.709010:0:17839:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e7303537800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789518332.709014:0:17839:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e7303537800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789518332.709016:0:17839:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e7303537800 3 00010000:00080000:2.0:1789518332.709049:0:17839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7437797000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789518332.716066:0:17839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789518332.716276:0:17839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789518332.716322:0:17839:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789518332.716335:0:17839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8d0fd679423154e9 00000100:00080000:2.0:1789518332.716344:0:17839:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518332.716356:0:17839:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e7437797000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518332.716391:0:17839:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033d8a80 x1876445522741248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518332.716427:0:17839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518332.717116:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522741248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518332.717189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518332.717384:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522741248 00000100:00100000:1.0:1789518332.717398:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522741248 00000100:00100000:1.0:1789518332.717432:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518332.717440:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1876445522741248:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789518332.717486:0:17092:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1789518332.717519:0:17092:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8d0fd679423154f0 00000004:00100000:1.0:1789518332.717535:0:17092:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789518332.717562:0:17092:0:(import.c:65:import_set_state_nolock()) ffff8e743f88c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518332.717630:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876445522741248:12345-0@lo:38:llog_process_th.0 Request processed in 189us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518332.717638:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789518332.717677:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e73033d8a80 x1876445522741248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518332.717688:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518332.717695:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789518332.717702:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789518332.717706:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518332.717708:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7437797000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518332.717713:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876445522741248:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789518332.722261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518332.722270:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518332.722273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518332.722276:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789518332.729948:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789518332.731731:0:17821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789518332.731784:0:17821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518332.731806:0:17821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6a00/0x8d0fd679423154d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154db expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518332.731819:0:17821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6a00/0x8d0fd679423154d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423154db expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518332.731879:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518332.731885:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789518332.731887:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518332.731888:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518332.731889:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518332.731890:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518332.731891:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518332.731892:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518332.731893:0:17821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518332.731897:0:17821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789518332.731899:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518332.731900:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789518332.731901:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518332.731902:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518332.731903:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518332.731904:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518332.731904:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518332.731905:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518332.731906:0:17821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518332.731933:0:17821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789518332.731953:0:17821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522741376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518332.732029:0:17821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518332.741864:0:17821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435f25e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518332.741898:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522741376 00000100:00100000:1.0:1789518332.741907:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522741376 00000100:00100000:1.0:1789518332.741960:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518332.741969:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522741376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518332.742000:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789518332.742012:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789518332.745345:0:17070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789518332.745591:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789518332.745605:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789518332.745725:0:17106:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789518332.745730:0:17106:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789518332.745754:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.745775:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.745783:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.745791:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.745834:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.745849:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 18 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.745863:0:17106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522741504:0@lo:104: 00000100:00100000:0.0:1789518332.745936:0:17106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518332.745985:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.745995:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 18 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.746003:0:17106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522741632:0@lo:104: 00000100:00100000:0.0:1789518332.746025:0:17106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.746047:0:17106:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518332.746140:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522741504 00000100:00100000:2.0:1789518332.746149:0:17074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522741504 00000100:00100000:2.0:1789518332.746181:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522741632 00000100:00100000:2.0:1789518332.746184:0:17074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522741632 00000100:00100000:2.0:1789518332.746199:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518332.746207:0:17074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+4:17106:x1876445522741504:12345-0@lo:104: 00010000:00010000:2.0:1789518332.746218:0:17074:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.746278:0:17074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518332.746285:0:17074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+4:17106:x1876445522741504:12345-0@lo:104: Request processed in 79us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518332.746292:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518332.746308:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518332.746315:0:17074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522741632:12345-0@lo:104: 00010000:00010000:2.0:1789518332.746322:0:17074:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518332.746369:0:17074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789518332.746375:0:17074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522741632:12345-0@lo:104: Request processed in 61us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518332.746381:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518332.746435:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17821:x1876445522741376:12345-0@lo:253:mount.lustre.0 Request processed in 4468us (14406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518332.746455:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518332.746991:0:17106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522741504:0@lo:104: 00000100:00100000:0.0:1789518332.747003:0:17106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522741632:0@lo:104: 00010000:00010000:0.0:1789518332.747028:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748705:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518332.748719:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748731:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518332.748736:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748746:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518332.748754:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518332.748760:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518332.748833:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748841:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518332.748872:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748880:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6000/0x8d0fd679423154b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423154bf expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748898:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518332.748901:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748906:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c600 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518332.748909:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748917:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518332.748923:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518332.748928:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518332.748941:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748947:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518332.748953:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748969:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e7435f0c600/0x8d0fd679423153f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153fb expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.748985:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518332.748987:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518332.748988:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518332.749022:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522741888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518332.749086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.749137:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518332.749144:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522741760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518332.749166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.749198:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522741888 00000100:00100000:0.0:1789518332.749206:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522741888 00010000:00010000:0.0:1789518332.749233:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 18 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.749258:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522741760 00000100:00100000:0.0:1789518332.749260:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522741760 00010000:00010000:0.0:1789518332.749272:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 19 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518332.749283:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518332.749290:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+19:3640:x1876445522741888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518332.749302:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518332.749307:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 19 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749317:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 19 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749337:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b7e00/0x8d0fd679423153fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423153f4 expref: 19 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749349:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518332.749383:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+18:3640:x1876445522741888:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.749389:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518332.749406:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518332.749412:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+17:3640:x1876445522741760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518332.749420:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518332.749424:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 17 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749432:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 17 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749441:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b6c00/0x8d0fd679423154bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423154b8 expref: 17 pid: 17084 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749451:0:17075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749459:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789518332.749501:0:17075:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003771596s 00010000:00010000:0.0:1789518332.749505:0:17075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749521:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749529:0:17075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749534:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749539:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518332.749543:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749550:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749565:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749588:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518332.749611:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+16:3640:x1876445522741760:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.749618:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518332.749654:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522741760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518332.749663:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522741888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518332.749688:0:17106:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749696:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518332.749708:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423154f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518332.750347:0:17821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:17821:1876445522741376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518332.750361:0:17821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789518332.750363:0:17821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518332.750366:0:17821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789518332.750367:0:17821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518332.750369:0:17821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518332.750370:0:17821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518332.750379:0:17821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518332.750380:0:17821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518332.750382:0:17821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518332.750383:0:17821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518332.750395:0:17821:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789518332.750516:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789518332.763657:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789518332.763729:0:17846:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789518332.763733:0:17846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789518332.764209:0:17847:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789518332.764505:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1789518332.764645:0:17847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518332.766754:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789518332.766840:0:17847:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1789518332.770511:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1876445522742016:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789518332.770600:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518332.770636:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66840 going to sleep for 11 seconds 00000040:01000000:1.0:1789518332.770797:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789518332.770836:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789518332.771270:0:17821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789518332.771278:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789518332.771317:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518332.772334:0:17821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789518332.772930:0:17821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789518332.772961:0:17821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789518332.773037:0:17821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789518332.773856:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742016 00000100:00100000:0.0:1789518332.773869:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742016 00000100:00100000:0.0:1789518332.773928:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518332.773940:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17848:x1876445522742016:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774068:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17848:x1876445522742016:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 130us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.774075:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518332.774149:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1876445522742016:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789518332.774186:0:17848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789518332.774233:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1876445522742144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774278:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.774305:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742144 00000100:00100000:0.0:1789518332.774309:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742144 00000100:00100000:0.0:1789518332.774330:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518332.774336:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17848:x1876445522742144:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774435:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17848:x1876445522742144:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.774443:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518332.774481:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518332.774495:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1876445522742144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774554:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17848:1876445522742272:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774646:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.774680:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742272 00000100:00100000:0.0:1789518332.774684:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742272 00000100:00100000:0.0:1789518332.774716:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518332.774722:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17848:x1876445522742272:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774756:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17848:x1876445522742272:12345-0@lo:900:lod0001_rec0000.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.774762:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518332.774778:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2180 going to sleep for 11 seconds 00010000:00080000:0.0:1789518332.774793:0:17848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e74079d2680 x1876445522742272/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789518348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518332.774803:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17848:1876445522742272:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774840:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1876445522742400:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774876:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518332.774894:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742400 00000100:00100000:0.0:1789518332.774898:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742400 00000100:00100000:0.0:1789518332.774917:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518332.774923:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17848:x1876445522742400:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789518332.774967:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17848:x1876445522742400:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518332.774973:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518332.774990:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518332.775000:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17848:1876445522742400:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789518332.775035:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518332.777099:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789518332.777189:0:17848:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789518332.777193:0:17848:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:1.0:1789518332.782319:0:17821:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1789518332.784456:0:17821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789518332.786419:0:17821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789518332.786448:0:17821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb9964569f988 00100000:10000000:1.0:1789518332.786454:0:17821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789518332.787240:0:17821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789518332.787274:0:17821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789518332.787294:0:17821:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789518332.787312:0:17821:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789518332.804044:0:17821:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789518332.804311:0:17821:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789518333.109607:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518333.710763:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000040:00080000:1.0:1789518333.750268:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789518334.006597:0:17087:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789518334.006616:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7303537800 from 8 10000000:01000000:0.0:1789518334.006621:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518334.006669:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518334.006682:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518334.006693:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518334.006719:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518334.006789:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518334.006850:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417ce240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518334.006862:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742528 00000100:00100000:2.0:1789518334.006870:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742528 00000100:00100000:2.0:1789518334.006930:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518334.006940:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+16:17087:x1876445522742528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518334.006953:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518334.006967:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423154fe expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518334.006990:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423154fe expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518334.007001:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423154fe expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518334.007009:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac800, rc 0) 00000100:00100000:2.0:1789518334.007059:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522742528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518334.007065:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789518334.008328:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518334.008350:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518334.008362:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518334.008432:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518334.008510:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518334.008613:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518334.014748:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742656 00000100:00100000:2.0:1789518334.014983:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742656 00000100:00100000:2.0:1789518334.015251:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789518334.015262:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522742656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789518334.015290:0:17082:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789518334.015311:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789518334.015314:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789518334.015496:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522742656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (6950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518334.015505:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518334.015538:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789518334.015607:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518334.015618:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518334.015629:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518334.015640:0:17087:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789518334.015642:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e743f99c000 from 8 10000000:01000000:0.0:1789518334.015645:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518334.015673:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518334.015685:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518334.015696:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518334.015715:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518334.015749:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518334.023992:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417ce300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518334.027014:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742784 00000100:00100000:3.0:1789518334.027030:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742784 00000100:00100000:3.0:1789518334.027092:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518334.027100:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522742784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518334.027117:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518334.027134:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd6794231550c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518334.027304:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd6794231550c expref: 18 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518334.027317:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231550c expref: 18 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518334.027326:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e74421c2200, rc 0) 00000100:00100000:3.0:1789518334.027414:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522742784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (11663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518334.027421:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518334.027526:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518334.027542:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518334.027553:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518334.028015:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518334.028060:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518334.028092:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7435e66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518334.028108:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522742912 00000100:00100000:3.0:1789518334.028112:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522742912 00000100:00100000:3.0:1789518334.028138:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789518334.028144:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522742912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789518334.028296:0:17083:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789518334.028312:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789518334.028315:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789518334.028390:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522742912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 245us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518334.028398:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789518334.028431:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522742912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518334.028490:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518334.028497:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518334.028506:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518334.133861:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518334.773969:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000040:00080000:1.0:1789518334.774546:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789518335.158791:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518335.799400:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:2.0:1789518336.186082:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518336.822852:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00010000:00010000:0.0:1789518337.206316:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518337.845546:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 0 seconds 00000001:02000400:1.0:1789518337.857875:0:18091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789518338.039055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789518338.039063:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789518338.039066:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518338.039086:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e74416ed000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518338.039109:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e91500 x1876445522743168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518338.039128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518338.039131:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518338.039141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518338.039143:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518338.039173:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518338.039177:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518338.039179:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518338.039182:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789518338.039346:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522743168:0@lo:38:kworker.0 00000100:00100000:3.0:1789518338.039417:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518338.039509:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522743424:0@lo:400:kworker.0 00000100:00100000:3.0:1789518338.039545:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518338.039566:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518338.039572:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522743552:0@lo:400:kworker.0 00000100:00100000:3.0:1789518338.039601:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518338.039928:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522743296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518338.039968:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518338.039990:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518338.039996:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522743040:0@lo:400:kworker.0 00000100:00100000:1.0:1789518338.040040:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518338.040076:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743552 00000100:00100000:1.0:1789518338.040084:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743552 00000100:00100000:1.0:1789518338.040124:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743296 00000100:00100000:1.0:1789518338.040127:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743296 00000100:00100000:1.0:1789518338.040142:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518338.040150:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522743552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518338.040214:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522743552:12345-0@lo:400:kworker.0 Request processed in 65us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518338.040222:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518338.040240:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518338.040245:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522743296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518338.040277:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522743296:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518338.040283:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518338.040304:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743040 00000100:00100000:1.0:1789518338.040307:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743040 00000100:00100000:1.0:1789518338.040331:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789518338.040337:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:3638:x1876445522743040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518338.040366:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:3638:x1876445522743040:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518338.040372:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789518338.040418:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7435e90700 x1876445522743552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518338.040444:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522743552:0@lo:400:kworker.0 00000100:00100000:1.0:1789518338.040506:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522743040:0@lo:400:kworker.0 00010000:00080000:1.0:1789518338.040518:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7435e90380 x1876445522743296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518338.040539:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522743296:0@lo:400:kworker.0 00000100:00100000:0.0:1789518338.044431:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743168 00000100:00100000:0.0:1789518338.044442:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743168 00000100:00100000:0.0:1789518338.044495:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743424 00000100:00100000:0.0:1789518338.044499:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743424 00000100:00100000:0.0:1789518338.044541:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518338.044549:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1876445522743168:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789518338.044579:0:17830:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:0.0:1789518338.044619:0:17830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd6794231551a 00000004:00100000:0.0:1789518338.044635:0:17830:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789518338.044641:0:17830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789518338.044734:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518338.044742:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522743424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518338.044836:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522743424:12345-0@lo:400:kworker.0 Request processed in 95us (5289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518338.044843:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518338.044889:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518338.044902:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522743680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518338.044938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518338.044967:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743680 00000100:00100000:0.0:1789518338.044972:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743680 00000100:00100000:0.0:1789518338.044988:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518338.044994:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522743680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518338.045016:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789518338.045053:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522743680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518338.045058:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518338.045096:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522743424:0@lo:400:kworker.0 00000100:00100000:0.0:1789518338.045125:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522743680:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789518338.056076:0:17830:0:(import.c:65:import_set_state_nolock()) ffff8e7409e28000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518338.056202:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1876445522743168:12345-0@lo:38:kworker.0 Request processed in 11650us (16782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518338.056215:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789518338.057811:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789518338.057827:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789518338.057834:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789518338.057839:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789518338.057864:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002a560215): req@ffff8e743f93bb80 x1876445522736256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518338.057886:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522743168:0@lo:38:kworker.0 00000100:00100000:3.0:1789518338.057985:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518338.058024:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74056da240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518338.058151:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522736256 00000100:00100000:0.0:1789518338.058159:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522736256 00000100:00100000:0.0:1789518338.058213:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518338.058222:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17131:x1876445522736256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789518338.058305:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17131:x1876445522736256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518338.058314:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518338.058339:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518338.058349:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522743808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518338.058383:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518338.058414:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17131:1876445522736256:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789518338.058444:0:17131:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789518338.058495:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17131:1876445522743936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789518338.058534:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518338.058555:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405f3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518338.058567:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743808 00000100:00100000:0.0:1789518338.058571:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743808 00000100:00100000:0.0:1789518338.058589:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522743936 00000100:00100000:0.0:1789518338.058591:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522743936 00000100:00100000:0.0:1789518338.058602:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518338.058607:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522743808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518338.058629:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789518338.059564:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1876445522743808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 953us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518338.059574:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518338.059594:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518338.059601:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17131:x1876445522743936:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789518338.060360:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17131:x1876445522743936:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 756us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518338.060369:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518338.060439:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522743808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518338.060498:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17131:1876445522743936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789518338.060592:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17131:1876445522744064:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789518338.060622:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518338.060658:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518338.060673:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744064 00000100:00100000:0.0:1789518338.060678:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744064 00000100:00100000:0.0:1789518338.060704:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518338.060711:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17131:x1876445522744064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789518338.060767:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17131:x1876445522744064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518338.060774:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518338.060796:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17131:1876445522744064:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789518338.060837:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518338.072407:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789518338.075113:0:17131:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1789518338.075127:0:17131:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789518338.229628:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789518338.742694:0:18143:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518338.743172:0:18143:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789518339.255692:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789518339.828450:0:18193:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518339.828782:0:18193:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789518340.277683:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518340.830139:0:18241:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd78031be0 20000000:00000080:1.0:1789518340.830160:0:18241:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e7436761c00 uarg=0000000000000000 20000000:01000000:1.0:1789518340.830247:0:18241:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789518340.830254:0:18241:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789518340.830259:0:18241:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789518340.834042:0:18242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789518340.834235:0:18241:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789518340.847759:0:18241:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789518340.847817:0:18241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.847839:0:18241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.847847:0:18241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.847854:0:18241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.847899:0:18241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.847934:0:18241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 17 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518340.847948:0:18241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1876445522744192:0@lo:104: 00000100:00100000:1.0:1789518340.848061:0:18241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518340.848151:0:18241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.848160:0:18241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 17 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518340.848168:0:18241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f939f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1876445522744320:0@lo:104: 00000100:00100000:1.0:1789518340.848190:0:18241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518340.848382:0:18241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e740560a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518340.848457:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744192 00000100:00100000:0.0:1789518340.848503:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744192 00000100:00100000:0.0:1789518340.848547:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744320 00000100:00100000:0.0:1789518340.848550:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744320 00000100:00100000:0.0:1789518340.848564:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518340.848573:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+4:18241:x1876445522744192:12345-0@lo:104: 00010000:00010000:0.0:1789518340.848585:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518340.848649:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518340.848655:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+4:18241:x1876445522744192:12345-0@lo:104: Request processed in 84us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518340.848662:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518340.848690:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518340.848696:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:18241:x1876445522744320:12345-0@lo:104: 00010000:00010000:0.0:1789518340.848704:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518340.848739:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518340.848744:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:18241:x1876445522744320:12345-0@lo:104: Request processed in 49us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518340.848750:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789518340.848808:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518340.848815:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848829:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518340.848833:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848841:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518340.848848:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518340.848854:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518340.848889:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848895:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518340.848916:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848923:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7400/0x8d0fd679423154c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423154cd expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848936:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518340.848939:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848944:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3e00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518340.848947:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848964:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518340.848970:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518340.848975:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518340.848990:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.848996:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518340.849003:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849010:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd679423153c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423153ca expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849024:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518340.849026:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518340.849028:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518340.849039:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522744448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518340.849072:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518340.849105:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518340.849111:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522744576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518340.849131:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518340.849168:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744448 00000100:00100000:3.0:1789518340.849172:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744448 00010000:00010000:3.0:1789518340.849192:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 18 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518340.849223:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744576 00000100:00100000:3.0:1789518340.849226:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744576 00010000:00010000:3.0:1789518340.849239:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 19 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518340.849250:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518340.849257:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6224dd85-753f-4c3f-83da-7a6019473f75+19:3639:x1876445522744448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518340.849266:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518340.849272:0:17076:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 19 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849281:0:17076:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 19 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849297:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518340.849325:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6224dd85-753f-4c3f-83da-7a6019473f75+19:3639:x1876445522744448:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518340.849332:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518340.849348:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518340.849354:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6224dd85-753f-4c3f-83da-7a6019473f75+18:3639:x1876445522744576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518340.849361:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518340.849365:0:17076:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 18 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849373:0:17076:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 18 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849384:0:17076:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849398:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849412:0:17076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849418:0:17076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849424:0:17076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849431:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849436:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518340.849441:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849447:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849455:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.849488:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518340.849524:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6224dd85-753f-4c3f-83da-7a6019473f75+18:3639:x1876445522744576:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518340.849531:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518340.849572:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522744576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518340.849588:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522744448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518340.849754:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e74421c3200/0x8d0fd679423154cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423154c6 expref: 17 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518340.849765:0:18241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1876445522744192:0@lo:104: 00010000:00010000:1.0:1789518340.849774:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e73033ad000/0x8d0fd679423153ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423153c3 expref: 16 pid: 17083 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518340.849782:0:18241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f939f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18241:1876445522744320:0@lo:104: 00010000:00010000:1.0:1789518340.849796:0:18241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.849805:0:18241:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.849821:0:18241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.849827:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d000/0x8d0fd67942315521 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518340.859090:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518341.306598:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518341.816362:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789518342.135315:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518332/real 1789518332] req@ffff8e74079d2d80 x1876445522739456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518342.135353:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e74079d2d80 x1876445522739456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518342.135403:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518332/real 1789518332] req@ffff8e74079d1c00 x1876445522739328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518342.135416:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e74079d1c00 x1876445522739328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518342.135434:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518342.135491:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789518342.135495:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522739456:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789518342.135501:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e743f88c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518342.135507:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789518342.135510:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522739328:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789518342.135675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518342.135680:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518342.135682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518342.135685:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518342.135716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518342.135720:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789518342.135723:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e743f88c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518342.135728:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1789518342.135732:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789518342.135742:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e743f88c000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518342.135771:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e74079d2680 x1876445522745216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518342.135783:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518342.135785:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789518342.135786:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518342.135789:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1789518342.135822:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789518342.135827:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7409e2b000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518342.135840:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303f55880 x1876445522745344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518342.135847:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522744704:0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.135921:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518342.136037:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744704 00000100:00100000:0.0:1789518342.136045:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744704 00000100:00100000:1.0:1789518342.136105:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522744960:0@lo:400:kworker.0 00000100:00100000:1.0:1789518342.136139:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518342.136244:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522745472:0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136274:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518342.136297:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518342.136302:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522744832:0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136353:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518342.136415:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518342.136425:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+16:3637:x1876445522744704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518342.136507:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+16:3637:x1876445522744704:12345-0@lo:400:kworker.0 Request processed in 83us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518342.136567:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522744704:0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136595:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518342.136599:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522745088:0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136632:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518342.136667:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744832 00000100:00100000:2.0:1789518342.136671:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744832 00000100:00100000:2.0:1789518342.136693:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522745088 00000100:00100000:2.0:1789518342.136695:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522745088 00000100:00100000:2.0:1789518342.136706:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518342.136711:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522744832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136752:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522744832:12345-0@lo:400:kworker.0 Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518342.136760:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518342.136774:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518342.136779:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522745088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136802:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522745088:12345-0@lo:400:kworker.0 Request processed in 23us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518342.136808:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518342.136836:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522745088:0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136854:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522744832:0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136878:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522744960 00000100:00100000:2.0:1789518342.136881:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522744960 00000100:00100000:2.0:1789518342.136900:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522745472 00000100:00100000:2.0:1789518342.136901:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522745472 00000100:00100000:2.0:1789518342.136911:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518342.136915:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522744960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136943:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522744960:12345-0@lo:400:kworker.0 Request processed in 27us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518342.136949:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518342.136970:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518342.136975:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522745472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518342.136998:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522745472:12345-0@lo:400:kworker.0 Request processed in 23us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518342.137004:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789518342.137026:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e74079d2d80 x1876445522744960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518342.137042:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522744960:0@lo:400:kworker.0 00010000:00080000:2.0:1789518342.137062:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7303f54700 x1876445522745472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518342.137071:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522745472:0@lo:400:kworker.0 00000100:00100000:3.0:1789518342.137337:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522745216:0@lo:8:kworker.0 00000400:00000100:3.0:1789518342.137367:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522745216 offset 0 length 520: 4 00000100:00100000:3.0:1789518342.137390:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522745344:0@lo:8:kworker.0 00000400:00000100:3.0:1789518342.137408:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522745344 offset 0 length 520: 4 00000100:00100000:0.0:1789518342.141148:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:1.0:1789518342.327528:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518342.581554:0:17087:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518342.581562:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7303537800 from 13 10000000:01000000:0.0:1789518342.581567:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518342.581616:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518342.581627:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518342.581638:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518342.581665:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518342.581739:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518342.581856:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431570480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518342.581899:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522745600 00000100:00100000:1.0:1789518342.581907:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522745600 00000100:00100000:1.0:1789518342.582120:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518342.582131:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+16:17087:x1876445522745600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518342.582145:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518342.582159:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315528 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518342.582182:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315528 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518342.582193:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315528 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518342.582203:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0ca00, rc 0) 00000100:00100000:1.0:1789518342.582279:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522745600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518342.582285:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789518342.582434:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518342.582449:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518342.582544:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518342.582611:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518342.582638:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518342.582667:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431570480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518342.582680:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522745728 00000100:00100000:2.0:1789518342.582686:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522745728 00000100:00100000:2.0:1789518342.582714:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789518342.582721:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522745728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518342.582826:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522745728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518342.582833:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789518342.582846:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518342.582872:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518342.582910:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518342.582932:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431570480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518342.582986:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522745856 00000100:00100000:1.0:1789518342.582990:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522745856 00000100:00100000:1.0:1789518342.583020:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518342.583026:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522745856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518342.583444:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522745856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 417us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518342.583453:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789518342.583629:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518342.584587:0:18321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789518342.588372:0:17087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789518342.588439:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518342.588451:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518342.588515:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518342.588527:0:17087:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518342.588530:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e743f99c000 from 13 10000000:01000000:3.0:1789518342.588533:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518342.588570:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518342.588579:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518342.588591:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518342.588616:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518342.588682:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518342.588731:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518342.589625:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522745984 00000100:00100000:0.0:1789518342.589634:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522745984 00000100:00100000:0.0:1789518342.589692:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789518342.589702:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+17:17087:x1876445522745984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518342.589717:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518342.589732:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315536 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518342.589757:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315536 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518342.589768:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315536 expref: 18 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518342.589789:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7600, rc 0) 00000100:00100000:0.0:1789518342.589849:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522745984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518342.589855:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789518342.591441:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522745984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518342.591510:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518342.591522:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518342.591609:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522746112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518342.591670:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518342.591707:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023913c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518342.591788:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522746112 00000100:00100000:1.0:1789518342.591795:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522746112 00000100:00100000:1.0:1789518342.591835:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518342.591844:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522746112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518342.591975:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522746112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518342.591983:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789518342.592648:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522746112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518342.592689:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522746240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518342.592736:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518342.592769:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73023913c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518342.592827:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522746240 00000100:00100000:1.0:1789518342.592832:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522746240 00000100:00100000:1.0:1789518342.592872:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789518342.592879:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522746240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518342.592968:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:17087:x1876445522746240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518342.592975:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518342.593055:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522746240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518342.593967:0:18322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789518342.594211:0:17087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789518342.594236:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518342.594246:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518342.594258:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518343.163583:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522746368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518343.163665:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518343.163741:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522746368 00000100:00100000:3.0:1789518343.163749:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522746368 00000100:00100000:3.0:1789518343.163795:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518343.163804:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522746368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518343.163841:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789518343.163891:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522746368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518343.163898:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518343.163946:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522746368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518343.165391:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518343.165408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522746496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518343.165459:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518343.165538:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522746496 00000100:00100000:2.0:1789518343.165544:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522746496 00000100:00100000:2.0:1789518343.165581:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518343.165588:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522746496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518343.165618:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789518343.165701:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522746496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518343.165708:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518343.165754:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522746496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789518343.349882:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518344.014858:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789518344.184203:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518329/real 1789518329] req@ffff8e73033db480 x1876445522737280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518344 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518344.184234:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e73033db480 x1876445522737280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518344 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518344.184255:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518329/real 1789518329] req@ffff8e73033d8700 x1876445522737408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518344 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518344.184267:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e73033d8700 x1876445522737408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518344 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518344.184285:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416e4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518344.184294:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518344.184301:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522737280:0@lo:8:kworker.0 00000100:00080000:1.0:1789518344.184305:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518344.184310:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518344.184312:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522737408:0@lo:8:kworker.0 00000100:00080000:0.0:1789518344.184592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518344.184596:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789518344.184598:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e74416e4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518344.184603:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1789518344.184608:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789518344.184618:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e74416e4800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518344.184636:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303f57b80 x1876445522746880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518344.184647:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518344.184650:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789518344.184652:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518344.184655:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1789518344.184657:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789518344.184661:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7402e82000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518344.184671:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303f54380 x1876445522747008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518344.184690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518344.184700:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518344.184703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518344.184706:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789518344.184788:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522747136:0@lo:400:kworker.0 00000100:00100000:0.0:1789518344.184848:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518344.184876:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518344.184882:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522746752:0@lo:400:kworker.0 00000100:00100000:0.0:1789518344.184908:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518344.184950:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522746752 00000100:00100000:0.0:1789518344.184957:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522746752 00000100:00100000:0.0:1789518344.184994:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518344.185003:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522746752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518344.185054:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522746752:12345-0@lo:400:kworker.0 Request processed in 51us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518344.185061:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518344.185096:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522746752:0@lo:400:kworker.0 00000100:00100000:1.0:1789518344.185181:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522747264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518344.185209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518344.185236:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789518344.185241:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522746624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518344.185265:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518344.185285:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522747392:0@lo:400:kworker.0 00000100:00100000:1.0:1789518344.185302:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518344.185326:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522746624 00000100:00100000:1.0:1789518344.185330:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522746624 00000100:00100000:1.0:1789518344.185356:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789518344.185362:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:3639:x1876445522746624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518344.185395:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+18:3639:x1876445522746624:12345-0@lo:400:kworker.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518344.185410:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789518344.185442:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522746624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518344.185457:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522746880:0@lo:8:kworker.0 00000400:00000100:1.0:1789518344.185503:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522746880 offset 0 length 520: 4 00000100:00100000:1.0:1789518344.185515:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522747008:0@lo:8:kworker.0 00000400:00000100:1.0:1789518344.185528:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445522747008 offset 0 length 520: 4 00000100:00100000:2.0:1789518344.185707:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522747136 00000100:00100000:2.0:1789518344.185718:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522747136 00000100:00100000:2.0:1789518344.185745:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522747392 00000100:00100000:2.0:1789518344.185748:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522747392 00000100:00100000:2.0:1789518344.185761:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518344.185766:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522747136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518344.185807:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522747136:12345-0@lo:400:kworker.0 Request processed in 41us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518344.185813:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518344.185825:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518344.185831:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522747392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518344.185863:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522747392:12345-0@lo:400:kworker.0 Request processed in 33us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518344.185868:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518344.185882:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522747264 00000100:00100000:2.0:1789518344.185885:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522747264 00000100:00100000:2.0:1789518344.185905:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518344.185911:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522747264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518344.185938:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522747264:12345-0@lo:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518344.185942:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789518344.185993:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7303f57100 x1876445522747392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518344.186003:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522747392:0@lo:400:kworker.0 00000100:00100000:2.0:1789518344.186012:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522747264:0@lo:400:kworker.0 00010000:00080000:2.0:1789518344.186824:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7303f57800 x1876445522747136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518344.186848:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522747136:0@lo:400:kworker.0 00000001:00100000:2.0:1789518344.188748:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789518344.373823:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518345.398278:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518346.423859:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518347.445693:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518347.907591:0:18590:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789518347.907595:0:18590:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789518347.907597:0:18590:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789518347.907717:0:18590:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e730205f000 00000020:01000004:1.0:1789518347.907733:0:18590:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789518347.907747:0:18590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789518347.907761:0:18590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e740dd9cd40) 00000020:00000080:1.0:1789518347.907776:0:18590:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789518347.973837:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789518347.976295:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789518347.976704:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789518347.977191:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789518347.977607:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789518347.977869:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789518347.978127:0:18590:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1789518347.980806:0:18590:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789518347.981046:0:18590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789518347.981069:0:18590:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789518347.981086:0:18590:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8d0fd6794231554b 00000020:01000004:0.0:1789518347.981093:0:18590:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789518347.981125:0:18590:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789518347.981129:0:18590:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789518347.981135:0:18590:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789518347.981140:0:18590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789518347.981153:0:18590:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e740482b380) 00000020:00000080:0.0:1789518347.981165:0:18590:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789518347.982316:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518347.982531:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789518347.982537:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789518347.986864:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518347.986874:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789518347.997272:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789518347.997341:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789518347.999807:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518348.000011:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789518348.000017:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789518348.003335:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789518348.003348:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789518348.039809:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518348.040212:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789518348.040219:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789518348.041827:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789518348.041841:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789518348.043794:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789518348.043808:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789518348.056783:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518348.056976:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789518348.056982:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789518348.058949:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518348.058961:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789518348.116456:0:18590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518348.116963:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789518348.116969:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789518348.119758:0:18590:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518348.119773:0:18590:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789518348.121333:0:18590:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789518348.121435:0:18590:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789518348.121442:0:18590:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789518348.158949:0:18590:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789518348.161595:0:18590:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789518348.161601:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789518348.161603:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789518348.161605:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518348.161607:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518348.161609:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518348.161610:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518348.161612:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518348.161613:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518348.161615:0:18590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518348.161619:0:18590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789518348.161621:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789518348.161623:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789518348.161624:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518348.161625:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518348.161626:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518348.161627:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518348.161628:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518348.161629:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518348.161630:0:18590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518348.161671:0:18590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789518348.161701:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747520:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789518348.161799:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.161875:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74039046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.161879:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522747520 00000100:00100000:1.0:1789518348.161898:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522747520 00000100:00100000:1.0:1789518348.162225:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518348.162240:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:18590:x1876445522747520:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518348.162299:0:17083:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789518348.162303:0:17083:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789518348.162318:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789518348.163590:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:18590:x1876445522747520:12345-0@lo:253:mount.lustre.0 Request processed in 1344us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.163608:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518348.164934:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747520:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789518348.164952:0:18590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789518348.164954:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518348.164956:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789518348.164957:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518348.164971:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518348.164972:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518348.164973:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518348.164974:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518348.164975:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518348.164976:0:18590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789518348.164997:0:18590:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e730205f000 from lustre-OST0000 10000000:01000000:3.0:1789518348.165031:0:18590:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789518348.165033:0:18590:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789518348.165080:0:18590:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e73030e99c0 local copy 00010000:00010000:3.0:1789518348.165090:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518348.165229:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518348.165287:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.165334:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74039046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.166515:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522747648 00000100:00100000:1.0:1789518348.166536:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522747648 00000100:00100000:1.0:1789518348.166618:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789518348.166633:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:18590:x1876445522747648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518348.166844:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+18:18590:x1876445522747648:12345-0@lo:501:mount.lustre.0 Request processed in 214us (1555us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518348.166854:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518348.166897:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747648:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789518348.166928:0:18590:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789518348.166969:0:18590:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789518348.166980:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.166991:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518348.167025:0:18590:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e730205f000 10000000:01000000:3.0:1789518348.167031:0:18590:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789518348.167037:0:18590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789518348.167039:0:18590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518348.167043:0:18590:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789518348.167046:0:18590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789518348.167088:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942315559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.167097:0:18590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942315559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.167107:0:18590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942315559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518348.167126:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518348.167178:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.167306:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74039046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.167380:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522747776 00000100:00100000:1.0:1789518348.167388:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522747776 00000100:00100000:1.0:1789518348.167526:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789518348.167536:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+18:18590:x1876445522747776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518348.167550:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518348.167563:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0c200/0x8d0fd67942315560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315559 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.167586:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0c200/0x8d0fd67942315560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315559 expref: 19 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.167597:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0c200/0x8d0fd67942315560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315559 expref: 19 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.167605:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c200, rc 0) 00000100:00100000:1.0:1789518348.167656:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522747776:12345-0@lo:101:mount.lustre.0 Request processed in 121us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.167662:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789518348.168382:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518348.168401:0:18590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942315559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315560 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.168411:0:18590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942315559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd67942315560 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518348.175931:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789518348.177756:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518348.185552:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789518348.185623:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789518348.185641:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789518348.185669:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789518348.185684:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789518348.185698:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789518348.185723:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789518348.185728:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789518348.185838:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518348.185910:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.185954:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74057363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.190043:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522747904 00000100:00100000:1.0:1789518348.190062:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522747904 00000100:00100000:1.0:1789518348.190134:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518348.190145:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522747904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518348.190408:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522747904:12345-0@lo:501:mount.lustre.0 Request processed in 264us (4497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.190416:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518348.193001:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522747904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518348.193071:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518348.193158:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.193211:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74057363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.193289:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748032 00000100:00100000:1.0:1789518348.193296:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748032 00000100:00100000:1.0:1789518348.193354:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789518348.193364:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522748032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518348.195779:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522748032:12345-0@lo:503:mount.lustre.0 Request processed in 2401us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.195800:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518348.195881:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748032:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518348.196444:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518348.196608:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518348.196699:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.196736:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74039046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518348.196813:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748160 00000100:00100000:0.0:1789518348.196822:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748160 00000100:00100000:0.0:1789518348.196919:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518348.196928:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522748160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518348.200029:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522748160:12345-0@lo:502:mount.lustre.0 Request processed in 3093us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518348.200062:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518348.200235:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518348.200532:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789518348.200564:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789518348.200579:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789518348.200592:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789518348.200605:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789518348.200618:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789518348.200629:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789518348.200658:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789518348.200672:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789518348.200906:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789518348.200921:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789518348.200935:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789518348.200972:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518348.201026:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.201084:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74057363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.201251:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748288 00000100:00100000:1.0:1789518348.201258:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748288 00000100:00100000:1.0:1789518348.201314:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789518348.201324:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522748288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.204937:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522748288:12345-0@lo:502:mount.lustre.0 Request processed in 3604us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.204954:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789518348.205491:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518348.205604:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789518348.205619:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789518348.208495:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518348.208508:0:18607:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789518348.208516:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518348.208519:0:18607:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789518348.208527:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518348.208545:0:18607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e743b253380) 00000020:00000080:3.0:1789518348.208573:0:18607:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789518348.208580:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789518348.208692:0:18607:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e730205f000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789518348.208704:0:18607:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789518348.208720:0:18607:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8d0fd6794231556e 00010000:00010000:2.0:1789518348.221244:0:18607:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789518348.229953:0:18607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789518348.232238:0:18607:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789518348.240033:0:18607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789518348.240047:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518348.240054:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518348.240056:0:18607:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789518348.240072:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789518348.240075:0:18607:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789518348.240076:0:18607:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518348.240077:0:18607:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518348.240079:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789518348.240081:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518348.240082:0:18607:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789518348.240084:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518348.240088:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518348.240089:0:18607:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789518348.240103:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789518348.240106:0:18607:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789518348.240109:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518348.240111:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518348.240112:0:18607:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789518348.240115:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518348.240117:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518348.240118:0:18607:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789518348.240122:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789518348.240151:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518348.240153:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518348.240155:0:18607:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789518348.240158:0:18607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789518348.248193:0:18590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789518348.248249:0:18590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789518348.248549:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942315559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315560 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.248564:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e74421c3e00/0x8d0fd67942315559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd67942315560 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518348.248572:0:18590:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e730205f000 from 1 10000000:01000000:3.0:1789518348.248575:0:18590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518348.248616:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.248625:0:18590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.248637:0:18590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518348.248664:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518348.248768:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.248815:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518348.254932:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748416 00000100:00100000:2.0:1789518348.254952:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748416 00000100:00100000:0.0:1789518348.265343:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518348.265369:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+19:18590:x1876445522748416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518348.265402:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518348.265453:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315575 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.265543:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315575 expref: 20 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.265556:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315575 expref: 20 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.265564:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7400, rc 0) 00000100:00100000:0.0:1789518348.265652:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522748416:12345-0@lo:101:mount.lustre.0 Request processed in 296us (16884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518348.265659:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789518348.266004:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518348.266028:0:18590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518348.266038:0:18590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518348.277243:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789518348.277615:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518348.278062:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789518348.278090:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789518348.278197:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789518348.278202:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789518348.278285:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518348.278358:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.278745:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748544 00000100:00100000:1.0:1789518348.278754:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748544 00000100:00100000:3.0:1789518348.279034:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.279149:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789518348.279160:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522748544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518348.279308:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522748544:12345-0@lo:501:mount.lustre.0 Request processed in 150us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.279316:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789518348.279394:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518348.279446:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518348.279517:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518348.289825:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522748928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518348.289951:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518348.289990:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518348.289996:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522748800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518348.290038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518348.290069:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748928 00000100:00100000:2.0:1789518348.290077:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748928 00000100:00100000:2.0:1789518348.290125:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748800 00000100:00100000:2.0:1789518348.290129:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748800 00000100:00100000:2.0:1789518348.290145:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789518348.290154:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522748928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518348.290188:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789518348.290249:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522748928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518348.290256:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789518348.290273:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789518348.290279:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522748800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518348.290295:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789518348.290324:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522748800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518348.290330:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789518348.290374:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522748800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518348.290385:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522748928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518348.295177:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743a4876c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518348.296930:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522748672 00000100:00100000:0.0:1789518348.296945:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522748672 00000100:00100000:0.0:1789518348.297010:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789518348.298217:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522748672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518348.298746:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522748672:12345-0@lo:503:mount.lustre.0 Request processed in 1726us (19227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.298758:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789518348.298939:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522748672:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518348.300966:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518348.301079:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518348.301154:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.301203:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7409dd73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518348.301225:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749056 00000100:00100000:3.0:1789518348.301232:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749056 00000100:00100000:3.0:1789518348.301271:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789518348.301279:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522749056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518348.304096:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522749056:12345-0@lo:502:mount.lustre.0 Request processed in 2809us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518348.304267:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789518348.307862:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518348.311811:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789518348.311865:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789518348.311873:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789518348.311881:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789518348.311888:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789518348.311895:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789518348.311910:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789518348.311916:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789518348.311924:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789518348.311930:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789518348.311938:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789518348.311979:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518348.312043:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518348.312086:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b55c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.312092:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749184 00000100:00100000:1.0:1789518348.312099:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749184 00000100:00100000:1.0:1789518348.312156:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789518348.312165:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522749184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.312655:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522749184:12345-0@lo:502:mount.lustre.0 Request processed in 490us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.312664:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789518348.315264:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518348.315387:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789518348.315403:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789518348.319811:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518348.319826:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.319828:0:18611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518348.319836:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e730205f000 00000020:00000080:0.0:1789518348.319839:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518348.319848:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518348.319851:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.319858:0:18611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789518348.319862:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518348.319865:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.319867:0:18611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518348.319870:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e730205f000 00000020:00000080:0.0:1789518348.319872:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518348.319985:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518348.319989:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.319991:0:18611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789518348.319994:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518348.319997:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.319998:0:18611:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518348.320001:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e730205f000 00000020:00000080:0.0:1789518348.320004:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518348.331117:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518348.331132:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.331135:0:18611:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518348.331139:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518348.331144:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.331145:0:18611:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789518348.331150:0:18611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e730205f000 00000020:00000080:0.0:1789518348.331153:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518348.331220:0:18611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518348.331231:0:18611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518348.331233:0:18611:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789518348.331236:0:18611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789518348.335500:0:18590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789518348.335558:0:18590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518348.335583:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.335598:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518348.335660:0:18590:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518348.335663:0:18590:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e730205f000 10000000:01000000:1.0:1789518348.335666:0:18590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e730205f000 10000000:01000000:1.0:1789518348.335669:0:18590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518348.335675:0:18590:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e730205f000 from 1 10000000:01000000:1.0:1789518348.335677:0:18590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518348.335713:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd67942315583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.335723:0:18590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd67942315583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.335733:0:18590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd67942315583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518348.335771:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518348.335834:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.335878:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031df3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518348.337114:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749312 00000100:00100000:3.0:1789518348.337127:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749312 00000100:00100000:3.0:1789518348.337756:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789518348.337769:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+20:18590:x1876445522749312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518348.337786:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518348.337803:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e74421c3200/0x8d0fd6794231558a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315583 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.337832:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e74421c3200/0x8d0fd6794231558a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315583 expref: 21 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.337844:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e74421c3200/0x8d0fd6794231558a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315583 expref: 21 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.337853:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e74421c3200, rc 0) 00000100:00100000:3.0:1789518348.337924:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749312:12345-0@lo:101:mount.lustre.0 Request processed in 158us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518348.337931:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789518348.338783:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518348.338806:0:18590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd67942315583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231558a expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.338817:0:18590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd67942315583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231558a expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518348.353998:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789518348.355420:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518348.355993:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789518348.356024:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789518348.356041:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789518348.356056:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789518348.356072:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789518348.356089:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789518348.356106:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789518348.356137:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789518348.356150:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789518348.356161:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789518348.356177:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789518348.356192:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789518348.356208:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789518348.356222:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789518348.357380:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789518348.357399:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789518348.357411:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789518348.357449:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789518348.357489:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789518348.357508:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789518348.357521:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789518348.357535:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789518348.357549:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789518348.357580:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789518348.357594:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789518348.357605:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789518348.357616:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789518348.357628:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789518348.357640:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789518348.357653:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789518348.357665:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789518348.357677:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789518348.357691:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789518348.357704:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789518348.357717:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789518348.357729:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789518348.357741:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789518348.357765:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789518348.357771:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789518348.357880:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518348.357947:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.357994:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.358024:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749440 00000100:00100000:1.0:1789518348.358031:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749440 00000100:00100000:1.0:1789518348.358079:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789518348.358087:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518348.358216:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749440:12345-0@lo:501:mount.lustre.0 Request processed in 128us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.358242:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789518348.358292:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518348.358322:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518348.358359:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.358382:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.358397:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749568 00000100:00100000:1.0:1789518348.358401:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749568 00000100:00100000:1.0:1789518348.358439:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518348.358446:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518348.358551:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749568:12345-0@lo:503:mount.lustre.0 Request processed in 106us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.358559:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518348.358605:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518348.358969:0:18590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518348.359044:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.359080:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.359098:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.359112:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749696 00000100:00100000:1.0:1789518348.359115:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749696 00000100:00100000:1.0:1789518348.359136:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518348.359141:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.359210:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749696:12345-0@lo:502:mount.lustre.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.359216:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789518348.359257:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518348.359409:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789518348.367694:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789518348.367734:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789518348.367749:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789518348.367762:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789518348.367774:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789518348.367787:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789518348.367799:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789518348.367813:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789518348.367825:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789518348.367838:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789518348.367849:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789518348.367860:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789518348.367871:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789518348.367884:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789518348.367922:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789518348.367940:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789518348.367953:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789518348.367966:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789518348.367978:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789518348.367991:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789518348.368004:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789518348.368017:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789518348.368034:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789518348.368047:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789518348.368062:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789518348.368076:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789518348.368090:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789518348.369754:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789518348.369773:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789518348.369787:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789518348.369825:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789518348.369841:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789518348.369856:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789518348.369870:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789518348.369883:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789518348.369894:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789518348.369906:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789518348.369919:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789518348.369932:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789518348.369943:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789518348.369956:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789518348.369969:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789518348.369983:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789518348.369994:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789518348.370008:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789518348.370021:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789518348.370049:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789518348.370119:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.370201:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.370249:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.370305:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749824 00000100:00100000:1.0:1789518348.370313:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749824 00000100:00100000:1.0:1789518348.370364:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789518348.370373:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.370528:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749824:12345-0@lo:502:mount.lustre.0 Request processed in 155us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.370535:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789518348.370593:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518348.370759:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789518348.370785:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789518348.370807:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.370840:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.370854:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.370866:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522749952 00000100:00100000:1.0:1789518348.370870:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522749952 00000100:00100000:1.0:1789518348.370892:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789518348.370898:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518348.370960:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522749952:12345-0@lo:502:mount.lustre.0 Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.370966:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789518348.371003:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522749952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518348.371036:0:18590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789518348.371044:0:18590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789518348.376073:0:18617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789518348.376104:0:18617:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e743b250000) 00000020:00000080:3.0:1789518348.376130:0:18617:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789518348.376356:0:18617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e730205f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518348.376361:0:18617:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e730205f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518348.376363:0:18617:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e730205f000 3 00010000:00080000:3.0:1789518348.376399:0:18617:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e730297f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518348.378735:0:18617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789518348.387302:0:18617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789518348.387360:0:18617:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518348.387373:0:18617:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8d0fd67942315598 00000100:00080000:3.0:1789518348.387384:0:18617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518348.387397:0:18617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e730297f800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518348.387445:0:18617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e90a80 x1876445522750080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518348.387711:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522750080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518348.387777:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518348.389365:0:18617:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789518348.389394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.389401:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518348.389403:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.389406:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518348.389454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.389458:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518348.389460:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.389490:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789518348.389522:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522750208:0@lo:400:kworker.0 00000100:00100000:3.0:1789518348.389573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.393871:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518348.393891:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522750336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518348.393950:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518348.396989:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750080 00000100:00100000:2.0:1789518348.397006:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750080 00000100:00100000:1.0:1789518348.398021:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750208 00000100:00100000:1.0:1789518348.398031:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750208 00000100:00100000:1.0:1789518348.398060:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750336 00000100:00100000:1.0:1789518348.398063:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750336 00000100:00100000:1.0:1789518348.398081:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518348.398102:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522750208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518348.398192:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522750208:12345-0@lo:400:kworker.0 Request processed in 103us (8618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.398200:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518348.398217:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518348.398223:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522750336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518348.398259:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522750336:12345-0@lo:400:kworker.0 Request processed in 37us (4310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.398275:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518348.398288:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518348.398292:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522750080:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789518348.398314:0:17091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:1.0:1789518348.398348:0:17091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8d0fd6794231559f 00000004:00100000:1.0:1789518348.398363:0:17091:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789518348.398392:0:17091:0:(import.c:65:import_set_state_nolock()) ffff8e7302968000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518348.398441:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876445522750080:12345-0@lo:38:llog_process_th.0 Request processed in 147us (10663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.398449:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789518348.399149:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7435e91c00 x1876445522750336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518348.399173:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522750336:0@lo:400:kworker.0 00010000:00080000:3.0:1789518348.399190:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7435e90000 x1876445522750208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518348.399198:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522750208:0@lo:400:kworker.0 00010000:00080000:3.0:1789518348.399247:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7435e90a80 x1876445522750080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518348.399256:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518348.399263:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789518348.399271:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789518348.399277:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789518348.399280:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e730297f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518348.399285:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1876445522750080:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1789518348.402202:0:18617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789518348.402222:0:18617:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e743b254d40) 00000020:00000080:3.0:1789518348.402259:0:18617:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789518348.402338:0:18617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e730205f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518348.402342:0:18617:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e730205f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518348.402344:0:18617:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e730205f000 3 00010000:00080000:3.0:1789518348.402397:0:18617:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e7302979000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518348.404052:0:18617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789518348.404250:0:18617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789518348.404291:0:18617:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518348.404305:0:18617:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8d0fd679423155ad 00000100:00080000:3.0:1789518348.404315:0:18617:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518348.404326:0:18617:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e7302979000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518348.404371:0:18617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7435e90a80 x1876445522750464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518348.404419:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1876445522750464:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518348.404538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518348.404611:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750464 00000100:00100000:3.0:1789518348.404619:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750464 00000100:00100000:3.0:1789518348.404646:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518348.404653:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522750464:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518348.404679:0:17091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:3.0:1789518348.404720:0:17091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8d0fd679423155b4 00000004:00100000:3.0:1789518348.404735:0:17091:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518348.404778:0:17091:0:(import.c:65:import_set_state_nolock()) ffff8e73019e8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518348.404831:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876445522750464:12345-0@lo:38:llog_process_th.0 Request processed in 177us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518348.404839:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789518348.404879:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e7435e90a80 x1876445522750464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518348.404889:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518348.404897:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789518348.404903:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789518348.404907:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789518348.404909:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7302979000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518348.404914:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1876445522750464:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789518348.404930:0:18617:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789518348.404954:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.404965:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518348.404968:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.404970:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518348.404974:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.404976:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518348.404978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518348.404981:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789518348.408907:0:18617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789518348.409029:0:18590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789518348.409061:0:18590:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518348.409085:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd67942315583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231558a expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518348.409202:0:18590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d600/0x8d0fd67942315583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231558a expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518348.409323:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518348.409326:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518348.409328:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518348.409329:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518348.409330:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518348.409332:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518348.409333:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518348.409336:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518348.409337:0:18590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518348.409342:0:18590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789518348.409344:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518348.409346:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518348.409352:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518348.409353:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518348.409354:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518348.409355:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518348.409356:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518348.409357:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518348.409357:0:18590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518348.409382:0:18590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789518348.409406:0:18590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522750592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518348.411406:0:18590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.411544:0:18590:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7413aecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518348.411575:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750592 00000100:00100000:1.0:1789518348.411584:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750592 00000100:00100000:1.0:1789518348.411628:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789518348.411636:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522750592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518348.411667:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789518348.411681:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789518348.420958:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789518348.420978:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789518348.421298:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:18590:x1876445522750592:12345-0@lo:253:mount.lustre.0 Request processed in 9657us (9892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.421310:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518348.421433:0:18590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:18590:1876445522750592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518348.421448:0:18590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789518348.421452:0:18590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518348.421453:0:18590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518348.421455:0:18590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518348.421456:0:18590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518348.421458:0:18590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518348.421459:0:18590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518348.421487:0:18590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518348.421490:0:18590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518348.421492:0:18590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789518348.421506:0:18590:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789518348.422034:0:17106:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789518348.422040:0:17106:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789518348.422061:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422076:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423154fe expref: 20 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422163:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd6794231550c expref: 20 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422171:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422205:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd6794231550c expref: 20 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422220:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd6794231550c expref: 20 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518348.422232:0:17106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522750720:0@lo:104: 00000100:00100000:0.0:1789518348.422271:0:17106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518348.422317:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423154fe expref: 20 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422325:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423154fe expref: 20 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518348.422333:0:17106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522750848:0@lo:104: 00000100:00100000:0.0:1789518348.422357:0:17106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518348.422373:0:17106:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e744172f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518348.422395:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518348.422407:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750720 00000100:00100000:0.0:1789518348.422413:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750720 00000100:00100000:0.0:1789518348.422452:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750848 00000100:00100000:0.0:1789518348.422456:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750848 00000100:00100000:0.0:1789518348.422492:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518348.422507:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+4:17106:x1876445522750720:12345-0@lo:104: 00010000:00010000:0.0:1789518348.422521:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422566:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518348.422572:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+4:17106:x1876445522750720:12345-0@lo:104: Request processed in 67us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518348.422579:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518348.422595:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518348.422601:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522750848:12345-0@lo:104: 00010000:00010000:0.0:1789518348.422608:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422640:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518348.422646:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522750848:12345-0@lo:104: Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518348.422651:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518348.422703:0:17106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522750720:0@lo:104: 00000100:00100000:0.0:1789518348.422711:0:17106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522750848:0@lo:104: 00010000:00010000:0.0:1789518348.422726:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422740:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518348.422745:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422751:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518348.422760:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422767:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518348.422774:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518348.422779:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518348.422806:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422812:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518348.422829:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422835:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd6794231550c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942315513 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422847:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518348.422850:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422855:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:0.0:1789518348.422857:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422863:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518348.422879:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518348.422885:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518348.422899:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422904:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518348.422910:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422916:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423154fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd67942315505 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.422930:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518348.422931:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518348.422933:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518348.422940:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518348.422956:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522750976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518348.422984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518348.423012:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518348.423017:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522751104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518348.423039:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518348.423067:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522750976 00000100:00100000:0.0:1789518348.423071:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522750976 00010000:00010000:0.0:1789518348.423088:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231550c expref: 21 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518348.423124:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522751104 00000100:00100000:0.0:1789518348.423133:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522751104 00010000:00010000:0.0:1789518348.423146:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423154fe expref: 22 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518348.423159:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518348.423165:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+22:3637:x1876445522750976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518348.423174:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518348.423178:0:17077:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd6794231550c expref: 22 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423188:0:17077:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd6794231550c expref: 22 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423199:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e74421c2200/0x8d0fd67942315513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd6794231550c expref: 22 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423209:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518348.423237:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+21:3637:x1876445522750976:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518348.423242:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518348.423254:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518348.423259:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404db4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+20:3637:x1876445522751104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518348.423266:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518348.423270:0:17077:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423154fe expref: 20 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423277:0:17077:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423154fe expref: 20 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423286:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e73033ac800/0x8d0fd67942315505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423154fe expref: 20 pid: 17083 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423302:0:17077:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423310:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789518348.423323:0:17077:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003771596s 00010000:00010000:0.0:1789518348.423327:0:17077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423334:0:17077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423340:0:17077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423346:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423352:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518348.423355:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423362:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423374:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423383:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518348.423412:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404db4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+19:3637:x1876445522751104:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518348.423419:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518348.423527:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522751104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518348.423535:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522750976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518348.423553:0:17106:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423560:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518348.423566:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b6000/0x8d0fd679423155bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1789518348.428721:0:18590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789518348.434951:0:18590:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789518348.434962:0:18590:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789518348.435004:0:18590:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518348.435058:0:18590:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518348.435076:0:18590:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789518348.435107:0:18590:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789518348.436153:0:18590:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518348.436387:0:18590:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789518348.472273:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518349.495776:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789518349.567929:0:18670:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518349.568209:0:18670:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789518349.941774:0:17087:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789518349.941782:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7303537800 from 9 10000000:01000000:0.0:1789518349.941787:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518349.941839:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.941851:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.941863:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518349.941892:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518349.941969:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518349.942044:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518349.944402:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522751232 00000100:00100000:1.0:1789518349.944427:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522751232 00000100:00100000:1.0:1789518349.945550:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789518349.945566:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+19:17087:x1876445522751232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518349.945584:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518349.945604:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423155c2 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518349.945650:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 20 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518349.945661:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 20 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518349.945669:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c600, rc 0) 00000100:00100000:1.0:1789518349.945741:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+20:17087:x1876445522751232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518349.945748:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789518349.945850:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518349.945869:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.945879:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518349.945942:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789518349.945982:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518349.958732:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518349.962319:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522751360 00000100:00100000:2.0:1789518349.962338:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522751360 00000100:00100000:0.0:1789518349.964559:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789518349.964572:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+20:17087:x1876445522751360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518349.964600:0:17083:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518349.964623:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518349.964626:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789518349.964761:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+20:17087:x1876445522751360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (18779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518349.964770:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789518349.964819:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789518349.964897:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518349.964906:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.964918:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518349.964937:0:17087:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789518349.964940:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e743f99c000 from 9 10000000:01000000:0.0:1789518349.964942:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518349.964971:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.964979:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.964988:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518349.965006:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518349.965037:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518349.965066:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518349.965214:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522751488 00000100:00100000:0.0:1789518349.965221:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522751488 00000100:00100000:0.0:1789518349.965241:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518349.965246:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+20:17087:x1876445522751488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518349.965254:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518349.965265:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423155d0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.965286:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 21 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.965455:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 21 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.965502:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7a00, rc 0) 00000100:00100000:0.0:1789518349.965534:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522751488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518349.965540:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518349.965572:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518349.965585:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.965594:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518349.965633:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789518349.965663:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518349.965697:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74316c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518349.965708:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522751616 00000100:00100000:0.0:1789518349.965712:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522751616 00000100:00100000:0.0:1789518349.965729:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789518349.965735:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7419693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522751616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518349.965745:0:17083:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518349.965757:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518349.965760:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789518349.965823:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7419693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522751616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518349.965830:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789518349.969048:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522751616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789518349.969201:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518349.969212:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518349.969225:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518350.519342:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518351.035278:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789518351.544203:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518352.565630:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518353.401821:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522751744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518353.401893:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518353.402031:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522751744 00000100:00100000:1.0:1789518353.402040:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522751744 00000100:00100000:1.0:1789518353.402095:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518353.402105:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522751744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518353.402143:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789518353.402195:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522751744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518353.402202:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518353.402288:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522751744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518353.402628:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522751872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518353.402704:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518353.402791:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522751872 00000100:00100000:2.0:1789518353.402797:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522751872 00000100:00100000:2.0:1789518353.402849:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518353.402856:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522751872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518353.402876:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789518353.402908:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522751872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518353.402913:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518353.402978:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522751872:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789518353.597456:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518353.909682:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518353.909689:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518353.909703:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518353.909707:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518353.909720:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518353.909723:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518353.909726:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518353.909729:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789518353.909788:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522752128:0@lo:400:kworker.0 00000100:00100000:3.0:1789518353.909868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518353.909918:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789518353.909925:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522752000:0@lo:400:kworker.0 00000100:00100000:3.0:1789518353.909954:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518353.909982:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522752512:0@lo:400:kworker.0 00000100:00100000:3.0:1789518353.910004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518353.910027:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522752256:0@lo:400:kworker.0 00000100:00100000:3.0:1789518353.910048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518353.910068:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518353.910073:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522752384:0@lo:400:kworker.0 00000100:00100000:3.0:1789518353.910092:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518353.910213:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752128 00000100:00100000:2.0:1789518353.910222:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752128 00000100:00100000:2.0:1789518353.910266:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752512 00000100:00100000:2.0:1789518353.910269:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752512 00000100:00100000:2.0:1789518353.910303:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752256 00000100:00100000:2.0:1789518353.910306:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752256 00000100:00100000:2.0:1789518353.910319:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752384 00000100:00100000:2.0:1789518353.910321:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752384 00000100:00100000:2.0:1789518353.910337:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518353.910344:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522752128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518353.910414:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522752128:12345-0@lo:400:kworker.0 Request processed in 70us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518353.910421:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518353.910439:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518353.910445:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522752512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518353.910490:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522752512:12345-0@lo:400:kworker.0 Request processed in 46us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518353.910496:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518353.910508:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518353.910513:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522752256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518353.910544:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522752256:12345-0@lo:400:kworker.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518353.910561:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518353.910573:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518353.910579:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522752384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518353.910608:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522752384:12345-0@lo:400:kworker.0 Request processed in 29us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518353.910614:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789518353.910675:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435e90380 x1876445522752384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518353.910691:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522752384:0@lo:400:kworker.0 00010000:00080000:2.0:1789518353.910704:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435e93480 x1876445522752256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518353.910711:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522752256:0@lo:400:kworker.0 00010000:00080000:2.0:1789518353.910752:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435e92680 x1876445522752512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518353.910761:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522752512:0@lo:400:kworker.0 00010000:00080000:2.0:1789518353.910770:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7435e92300 x1876445522752128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518353.910778:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522752128:0@lo:400:kworker.0 00000100:00100000:3.0:1789518353.910859:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752000 00000100:00100000:3.0:1789518353.910865:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752000 00000100:00100000:3.0:1789518353.910902:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789518353.910909:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:3638:x1876445522752000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518353.910945:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:3638:x1876445522752000:12345-0@lo:400:kworker.0 Request processed in 37us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518353.910958:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789518353.911062:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522752000:0@lo:400:kworker.0 00000100:00080000:0.0:1789518353.911497:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518353.911503:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1789518354.300746:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789518354.620768:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518355.307049:0:18960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789518355.637753:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789518356.271433:0:19012:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518356.272048:0:19012:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789518356.661633:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789518357.372932:0:19062:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789518357.373754:0:19062:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789518357.621602:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518342/real 1789518342] req@ffff8e74079d2680 x1876445522745216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518357 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518357.621640:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e74079d2680 x1876445522745216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518357 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518357.621650:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518342/real 1789518342] req@ffff8e7303f55880 x1876445522745344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518357 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518357.621661:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7303f55880 x1876445522745344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518357 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518357.621682:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e743f88c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518357.621705:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789518357.621710:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522745216:0@lo:8:kworker.0 00000100:00080000:3.0:1789518357.621716:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518357.621721:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789518357.621723:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522745344:0@lo:8:kworker.0 00000100:00080000:0.0:1789518357.621906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518357.621912:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518357.621914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518357.621917:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518357.621944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518357.621948:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789518357.621951:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e743f88c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518357.621956:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1789518357.621961:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789518357.621970:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e743f88c000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518357.621991:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303f56300 x1876445522753152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518357.622034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518357.622037:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789518357.622039:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518357.622042:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1789518357.622044:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789518357.622049:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7409e2b000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518357.622061:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303f57480 x1876445522753280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518357.622351:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522752768:0@lo:400:kworker.0 00000100:00100000:1.0:1789518357.622418:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518357.622523:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522753536:0@lo:400:kworker.0 00000100:00100000:1.0:1789518357.622555:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518357.622585:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789518357.622590:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522752896:0@lo:400:kworker.0 00000100:00100000:1.0:1789518357.622610:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518357.622624:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522753664:0@lo:400:kworker.0 00000100:00100000:1.0:1789518357.622642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518357.622722:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522753024:0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.622749:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518357.622780:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789518357.622786:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522752640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.622812:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518357.622834:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522753408:0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.622901:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518357.622927:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753536 00000100:00100000:3.0:1789518357.622944:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753536 00000100:00100000:3.0:1789518357.622995:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752896 00000100:00100000:3.0:1789518357.622999:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752896 00000100:00100000:3.0:1789518357.623023:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753664 00000100:00100000:3.0:1789518357.623026:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753664 00000100:00100000:3.0:1789518357.623040:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753408 00000100:00100000:3.0:1789518357.623043:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753408 00000100:00100000:3.0:1789518357.623057:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518357.623065:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522753536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.623118:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522753536:12345-0@lo:400:kworker.0 Request processed in 54us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.623321:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518357.623351:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518357.623358:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522752896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.623389:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522752896:12345-0@lo:400:kworker.0 Request processed in 32us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.623394:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518357.623405:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518357.623411:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522753664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.623435:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522753664:12345-0@lo:400:kworker.0 Request processed in 25us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.623440:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518357.623451:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789518357.623456:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522753408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.623520:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522753408:12345-0@lo:400:kworker.0 Request processed in 64us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.623532:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789518357.623559:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752640 00000100:00100000:3.0:1789518357.623563:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752640 00000100:00100000:3.0:1789518357.623590:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789518357.623596:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:3637:x1876445522752640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.623626:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:3637:x1876445522752640:12345-0@lo:400:kworker.0 Request processed in 30us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.623631:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789518357.623655:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518357.623659:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518357.623687:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522752640:0@lo:400:kworker.0 00010000:00080000:3.0:1789518357.623699:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303f55f80 x1876445522753408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518357.623710:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522753408:0@lo:400:kworker.0 00000100:00100000:3.0:1789518357.623737:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522753152:0@lo:8:kworker.0 00000100:00100000:3.0:1789518357.623817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518357.623836:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522753280:0@lo:8:kworker.0 00000100:00100000:3.0:1789518357.623851:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518357.623883:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753152 00000100:00100000:3.0:1789518357.623887:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753152 00000100:00100000:3.0:1789518357.623902:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753280 00000100:00100000:3.0:1789518357.623904:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753280 00000100:00100000:3.0:1789518357.623912:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518357.623917:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522753152:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789518357.624064:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522752768 00000100:00100000:1.0:1789518357.624070:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522752768 00000100:00100000:1.0:1789518357.624098:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753024 00000100:00100000:1.0:1789518357.624101:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753024 00000100:00100000:1.0:1789518357.624113:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518357.624119:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522752768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518357.624167:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522752768:12345-0@lo:400:kworker.0 Request processed in 48us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518357.624172:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518357.624185:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518357.624191:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522753024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518357.624222:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522753024:12345-0@lo:400:kworker.0 Request processed in 32us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518357.624227:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789518357.624426:0:18596:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1789518357.624495:0:18596:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd679423155de 00002000:00100000:3.0:1789518357.624510:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e73019eb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789518357.624515:0:18596:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789518357.624518:0:18596:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789518357.624696:0:18596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789518357.624720:0:18596:0:(import.c:65:import_set_state_nolock()) ffff8e73019eb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518357.624762:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1876445522753152:12345-0@lo:8:kworker.0 Request processed in 844us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.624768:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518357.624784:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518357.624788:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522753280:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789518357.624801:0:18596:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789518357.626089:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303f56300 x1876445522753152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518357.626103:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518357.626112:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789518357.626131:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789518357.626138:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789518357.626141:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e743f88c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789518357.626169:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789518357.626191:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522753152:0@lo:8:kworker.0 00000004:00080000:0.0:1789518357.626280:0:17831:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789518357.626373:0:17831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 525411908428ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789518357.626380:0:17831:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789518357.626531:0:17832:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000401:0x1:0x0] 00000100:00100000:2.0:1789518357.626553:0:17832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17832:1876445522753920:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789518357.626609:0:17832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518357.626636:0:17832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7402afdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518357.626655:0:18595:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518357.626661:0:18595:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789518357.626760:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753920 00000100:00100000:2.0:1789518357.626766:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753920 00000100:00100000:2.0:1789518357.626865:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518357.626874:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17832:x1876445522753920:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789518357.627235:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518357.627247:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522753792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518357.627285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789518357.627625:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303f55500 x1876445522752896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518357.627637:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522752896:0@lo:400:kworker.0 00010000:00080000:0.0:1789518357.627654:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303f57800 x1876445522753664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518357.627662:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522753664:0@lo:400:kworker.0 00000100:00100000:0.0:1789518357.627674:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522752768:0@lo:400:kworker.0 00010000:00080000:0.0:1789518357.627687:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303f55880 x1876445522753536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518357.627706:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522753536:0@lo:400:kworker.0 00000100:00100000:2.0:1789518357.628511:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522753792 00000100:00100000:2.0:1789518357.628519:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522753792 00000100:00100000:2.0:1789518357.628557:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518357.628565:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1876445522753792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518357.628590:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518357.628652:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1876445522753792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518357.628659:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789518357.628706:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033d8000 x1876445522753792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518357.628722:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522753792:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1789518357.630903:0:19074:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789518357.630913:0:19074:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x21:0x0] 00000100:00100000:0.0:1789518357.631017:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17832:x1876445522753920:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4138us (4401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518357.631035:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789518357.631384:0:17832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033db480 x1876445522753920/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518373 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518357.631402:0:17832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17832:1876445522753920:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789518357.631416:0:17832:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000401:0x21:0x0] 00000100:00100000:2.0:1789518357.631482:0:17832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17832:1876445522754048:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789518357.631533:0:17832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518357.631562:0:17832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7404deb540 going to sleep for 11 seconds 00000004:00080000:1.0:1789518357.631720:0:17822:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789518357.632256:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754048 00000100:00100000:0.0:1789518357.632266:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754048 00000100:00100000:0.0:1789518357.632331:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518357.632348:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17832:x1876445522754048:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789518357.632386:0:18595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789518357.632445:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17832:x1876445522754048:12345-0@lo:5:osp-pre-0-1.0 Request processed in 106us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518357.632455:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789518357.632562:0:17832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033db480 x1876445522754048/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518373 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518357.632574:0:17832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17832:1876445522754048:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789518357.632584:0:17832:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x21:0x0] 00000100:00100000:2.0:1789518357.632615:0:17832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17832:1876445522754176:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789518357.632649:0:17832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518357.632670:0:17832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7404deb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518357.632735:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754176 00000100:00100000:1.0:1789518357.632742:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754176 00000100:00100000:1.0:1789518357.632772:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518357.632779:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17832:x1876445522754176:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789518357.632810:0:18597:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:2.0:1789518357.633725:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522753024:0@lo:400:kworker.0 00000100:00080000:2.0:1789518357.635572:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518357.660828:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522753280:12345-0@lo:8:kworker.0 Request processed in 36032us (36969us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789518357.660842:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789518357.660900:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518357.660906:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518357.660910:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522753280:0@lo:8:kworker.0 00000001:00080000:2.0:1789518357.668230:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789518357.668247:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789518357.668701:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17832:x1876445522754176:12345-0@lo:5:osp-pre-0-1.0 Request processed in 35916us (36048us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789518357.668713:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789518357.668896:0:17832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033db480 x1876445522754176/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518373 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518357.668909:0:17832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789518357.668915:0:17832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17832:1876445522754176:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789518357.668932:0:17832:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1789518357.669025:0:17832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17832:1876445522754304:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789518357.669075:0:17832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518357.669138:0:17832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7404deb540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518357.669707:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754304 00000100:00100000:0.0:1789518357.669715:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754304 00000100:00100000:0.0:1789518357.669789:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518357.669799:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17832:x1876445522754304:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789518357.669862:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17832:x1876445522754304:12345-0@lo:900:osp-pre-0-1.0 Request processed in 65us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518357.669869:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789518357.669926:0:17832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033db480 x1876445522754304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789518373 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518357.669938:0:17832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17832:1876445522754304:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1789518357.693824:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518358.522868:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522754432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518358.522952:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518358.523035:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518358.523043:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522754560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518358.523069:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518358.523098:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754432 00000100:00100000:2.0:1789518358.523106:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754432 00000100:00100000:2.0:1789518358.523283:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754560 00000100:00100000:2.0:1789518358.523289:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754560 00000100:00100000:2.0:1789518358.523308:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518358.523315:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522754432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789518358.523617:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789518358.523679:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522754432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 358us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518358.523768:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518358.523795:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518358.523807:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522754560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789518358.523832:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789518358.523875:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522754432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518358.523888:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522754560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518358.523897:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518358.526208:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522754560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789518358.711011:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518359.735515:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518360.759678:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518361.270371:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789518361.784172:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518362.812593:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518363.126396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518363.126403:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518363.126406:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518363.126409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518363.126430:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518363.126442:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789518363.126446:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518363.126454:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1789518363.126486:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789518363.126511:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7409e2b000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518363.126535:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303db4a80 x1876445522755328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518363.126590:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522755072:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.126660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.126721:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522755712:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.126749:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.126774:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789518363.126780:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522754688:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.126809:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.126834:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522755200:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.126860:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.126897:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522754944:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.126921:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.126939:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522755584:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.126969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.126988:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789518363.126993:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522754816:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.127014:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.127030:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522755456:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.127063:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.127086:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755712 00000100:00100000:3.0:1789518363.127093:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755712 00000100:00100000:3.0:1789518363.127150:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754944 00000100:00100000:3.0:1789518363.127153:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754944 00000100:00100000:3.0:1789518363.127166:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755584 00000100:00100000:3.0:1789518363.127168:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755584 00000100:00100000:3.0:1789518363.127179:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755456 00000100:00100000:3.0:1789518363.127182:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755456 00000100:00100000:3.0:1789518363.127195:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789518363.127204:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522755712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.127254:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522755712:12345-0@lo:400:kworker.0 Request processed in 51us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.127262:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789518363.127277:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518363.127283:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522754944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.127328:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876445522754944:12345-0@lo:400:kworker.0 Request processed in 45us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.127333:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518363.127344:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518363.127350:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522755584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.127376:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876445522755584:12345-0@lo:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.127381:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518363.127392:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518363.127397:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522755456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.127422:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876445522755456:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.127436:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789518363.127496:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303db7800 x1876445522755456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518363.127509:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876445522755456:0@lo:400:kworker.0 00010000:00080000:3.0:1789518363.127521:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303db6680 x1876445522754944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518363.127529:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876445522754944:0@lo:400:kworker.0 00010000:00080000:3.0:1789518363.127538:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303db7b80 x1876445522755584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518363.127545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1876445522755584:0@lo:400:kworker.0 00010000:00080000:3.0:1789518363.127577:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303db5c00 x1876445522755712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518363.127587:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522755712:0@lo:400:kworker.0 00000100:00100000:0.0:1789518363.128775:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755072 00000100:00100000:0.0:1789518363.128786:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755072 00000100:00100000:0.0:1789518363.128827:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754816 00000100:00100000:0.0:1789518363.128830:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754816 00000100:00100000:0.0:1789518363.128861:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518363.128868:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522755072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518363.128941:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522755072:12345-0@lo:400:kworker.0 Request processed in 73us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518363.128947:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518363.129078:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518363.129086:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522754816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518363.129121:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522754816:12345-0@lo:400:kworker.0 Request processed in 36us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518363.129127:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518363.129153:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522755328:0@lo:8:kworker.0 00000100:00100000:0.0:1789518363.129191:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518363.129249:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755200 00000100:00100000:0.0:1789518363.129254:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755200 00000100:00100000:0.0:1789518363.129281:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755328 00000100:00100000:0.0:1789518363.129283:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755328 00000100:00100000:0.0:1789518363.129316:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518363.129323:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522755200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518363.129355:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522755200:12345-0@lo:400:kworker.0 Request processed in 34us (2495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518363.129361:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518363.129372:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518363.129376:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1876445522755328:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789518363.129393:0:19074:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789518363.129437:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1876445522755328:12345-0@lo:8:kworker.0 Request processed in 59us (246us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789518363.129453:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789518363.129595:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518363.129600:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518363.129604:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522755328:0@lo:8:kworker.0 00000100:00100000:3.0:1789518363.130370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522754816:0@lo:400:kworker.0 00010000:00080000:3.0:1789518363.130408:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303db7480 x1876445522755200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518363.130418:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522755200:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.130431:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522755072:0@lo:400:kworker.0 00000100:00100000:2.0:1789518363.131375:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522754688 00000100:00100000:2.0:1789518363.131387:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522754688 00000100:00100000:2.0:1789518363.131455:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789518363.131484:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+21:3639:x1876445522754688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518363.131557:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+21:3639:x1876445522754688:12345-0@lo:400:kworker.0 Request processed in 75us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518363.131564:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1789518363.131610:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518363.131615:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518363.131618:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518363.131636:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522755840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518363.131646:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522754688:0@lo:400:kworker.0 00000100:00100000:3.0:1789518363.131683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518363.131860:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755840 00000100:00100000:2.0:1789518363.131864:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755840 00000100:00100000:2.0:1789518363.131900:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518363.131908:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522755840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518363.131929:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518363.131965:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522755840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518363.131971:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789518363.131998:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303600700 x1876445522755840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518363.132013:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522755840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518363.637703:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522755968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518363.637776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518363.637868:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522755968 00000100:00100000:3.0:1789518363.637884:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522755968 00000100:00100000:3.0:1789518363.637956:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518363.637967:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522755968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518363.638003:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789518363.638059:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522755968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.638067:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518363.638113:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522755968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518363.639234:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522756096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789518363.639281:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518363.641586:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756096 00000100:00100000:0.0:1789518363.641598:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756096 00000100:00100000:0.0:1789518363.641646:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518363.641655:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522756096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518363.641688:0:17830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789518363.641765:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522756096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518363.641772:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518363.641818:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522756096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789518363.831264:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518364.149633:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518344/real 1789518344] req@ffff8e7303f57b80 x1876445522746880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518364 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518364.149669:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7303f57b80 x1876445522746880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518364 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518364.149679:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518344/real 1789518344] req@ffff8e7303f54380 x1876445522747008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518364 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518364.149689:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e7303f54380 x1876445522747008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518364 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789518364.149734:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416e4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518364.149758:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789518364.149763:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522746880:0@lo:8:kworker.0 00000100:00080000:0.0:1789518364.149769:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518364.149773:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789518364.149776:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522747008:0@lo:8:kworker.0 00000100:00080000:1.0:1789518364.152149:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518364.152157:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789518364.152160:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e74416e4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518364.152168:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1789518364.152183:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789518364.152196:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e74416e4800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518364.152211:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522756224:0@lo:400:kworker.0 00000100:00100000:1.0:1789518364.152222:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f938380 x1876445522756352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518364.152238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518364.152241:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789518364.152243:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518364.152247:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1789518364.152250:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789518364.152271:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7402e82000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518364.152299:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e743f93bb80 x1876445522756480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518364.152307:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518364.152357:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518364.152362:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789518364.152364:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518364.152368:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1789518364.152370:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1789518364.152375:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1789518364.152378:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7409e2b000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789518364.152392:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522756608:0@lo:400:kworker.0 00000100:00100000:1.0:1789518364.152394:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033e4a80 x1876445522756864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518364.152436:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518364.152615:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756224 00000100:00100000:3.0:1789518364.152625:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756224 00000100:00100000:3.0:1789518364.152670:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789518364.152680:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:3639:x1876445522756224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518364.152732:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:3639:x1876445522756224:12345-0@lo:400:kworker.0 Request processed in 54us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518364.152738:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789518364.152770:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522756736:0@lo:400:kworker.0 00000100:00100000:3.0:1789518364.152796:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518364.152820:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518364.152826:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522756992:0@lo:400:kworker.0 00000100:00100000:3.0:1789518364.152848:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518364.152874:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756608 00000100:00100000:3.0:1789518364.152878:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756608 00000100:00100000:3.0:1789518364.152911:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756992 00000100:00100000:3.0:1789518364.152914:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756992 00000100:00100000:3.0:1789518364.152931:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518364.152939:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522756608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518364.152973:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522756608:12345-0@lo:400:kworker.0 Request processed in 35us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518364.152985:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518364.152999:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518364.153004:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522756992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518364.153050:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522756992:12345-0@lo:400:kworker.0 Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518364.153056:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518364.153075:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756736 00000100:00100000:3.0:1789518364.153079:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756736 00000100:00100000:3.0:1789518364.153105:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518364.153112:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522756736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518364.153142:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522756736:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518364.153147:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518364.153167:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522757120:0@lo:400:kworker.0 00000100:00100000:2.0:1789518364.153200:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789518364.153249:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e4380 x1876445522756608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518364.153261:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522756608:0@lo:400:kworker.0 00000100:00100000:2.0:1789518364.153270:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522756224:0@lo:400:kworker.0 00000100:00100000:2.0:1789518364.153307:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518364.153313:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522757248:0@lo:400:kworker.0 00000100:00100000:2.0:1789518364.153336:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518364.153508:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522757120 00000100:00100000:3.0:1789518364.153513:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522757120 00000100:00100000:3.0:1789518364.153545:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522757248 00000100:00100000:3.0:1789518364.153548:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522757248 00000100:00100000:3.0:1789518364.153563:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518364.153571:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522757120:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789518364.153700:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e5f80 x1876445522756992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518364.153712:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522756992:0@lo:400:kworker.0 00010000:00080000:1.0:1789518364.153724:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e5500 x1876445522756736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518364.153731:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522756736:0@lo:400:kworker.0 00000100:00100000:0.0:1789518364.153822:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522756352:0@lo:8:kworker.0 00000100:00100000:0.0:1789518364.153861:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518364.153904:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522756480:0@lo:8:kworker.0 00000100:00100000:0.0:1789518364.153927:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518364.153950:0:17092:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518364.153951:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522756864:0@lo:8:kworker.0 00000100:00100000:2.0:1789518364.153963:0:17092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789518364.153978:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518364.153996:0:17091:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518364.154008:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789518364.154017:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522757248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518364.154020:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756352 00000100:00100000:0.0:1789518364.154025:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756352 00000100:00100000:0.0:1789518364.154048:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756480 00000100:00100000:0.0:1789518364.154051:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756480 00000100:00100000:0.0:1789518364.154062:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522756864 00000100:00100000:2.0:1789518364.154065:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522757248:12345-0@lo:400:kworker.0 Request processed in 48us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518364.154066:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522756864 00000100:00100000:2.0:1789518364.154076:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518364.154081:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518364.154086:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1876445522756352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789518364.154110:0:18595:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1789518364.154142:0:18595:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd679423155e5 00002000:00100000:0.0:1789518364.154157:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e7405718000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789518364.154161:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789518364.154188:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1789518364.154200:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e4700 x1876445522757248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518364.154211:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522757248:0@lo:400:kworker.0 00000100:00100000:2.0:1789518364.154245:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518364.154251:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1876445522756480:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789518364.154265:0:19074:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00080000:0.0:1789518364.154296:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518364.154322:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8e740571d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518364.154328:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1876445522756480:12345-0@lo:8:kworker.0 Request processed in 73us (397us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789518364.154336:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518364.154354:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518364.154359:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1876445522756864:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789518364.154368:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876445522756352:12345-0@lo:8:kworker.0 Request processed in 279us (505us total) trans 0 rc 0/0 00010000:00020000:2.0:1789518364.154370:0:19074:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789518364.154380:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518364.154404:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1876445522756864:12345-0@lo:8:kworker.0 Request processed in 43us (425us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789518364.154412:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789518364.154415:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e743f938380 x1876445522756352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518364.154425:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518364.154432:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789518364.154440:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789518364.154445:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789518364.154448:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74416e4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789518364.154461:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789518364.154502:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522756352:0@lo:8:kworker.0 00000100:00080000:0.0:1789518364.154514:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518364.154519:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518364.154522:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522756480:0@lo:8:kworker.0 00000100:00080000:0.0:1789518364.154529:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518364.154533:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518364.154537:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522756864:0@lo:8:kworker.0 00000004:00080000:2.0:1789518364.154541:0:17115:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789518364.154559:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518364.154561:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17115:1876445522757504:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789518364.154571:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522757376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518364.154603:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518364.154635:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522757376 00000100:00100000:0.0:1789518364.154639:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522757376 00000100:00100000:0.0:1789518364.154683:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518364.154689:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522757376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518364.154702:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789518364.154742:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522757376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518364.154748:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789518364.154765:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789518364.154780:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e743f938e00 x1876445522757376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518364.154793:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522757376:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789518364.154853:0:17114:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789518364.154923:0:17114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 531940458858ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789518364.154930:0:17114:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789518364.154997:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522757120:12345-0@lo:400:kworker.0 Request processed in 1425us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518364.155005:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789518364.155038:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e5180 x1876445522757120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518364.155061:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522757120:0@lo:400:kworker.0 00000100:00100000:2.0:1789518364.155251:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518364.155327:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730348c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518364.159622:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522757504 00000100:00100000:1.0:1789518364.159639:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522757504 00000100:00100000:1.0:1789518364.159714:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518364.159725:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17115:x1876445522757504:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789518364.166625:0:17070:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789518364.168836:0:18595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789518364.168851:0:18595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789518364.168858:0:18595:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1789518364.186636:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.186648:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.186666:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=531s v=(0 0) 00010000:00010000:0.0:1789518364.186672:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.186782:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.186805:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.186817:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.186833:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.186891:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518364.188696:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.188710:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.188726:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=531s v=(0 0) 00010000:00010000:0.0:1789518364.188729:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.188734:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.188747:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.188756:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.188763:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.193293:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518364.193314:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.193329:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.193335:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.193347:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.193380:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.193388:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd679423155ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.194954:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518364.195180:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.195190:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.195203:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.195209:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.195240:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.195257:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.195264:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd679423155f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.195300:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.195303:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.195306:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518364.198305:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518364.198312:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518364.198331:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518364.206103:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518364.206117:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.206136:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1789518364.206141:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.206148:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.206163:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.206172:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.206180:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.206206:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518364.206460:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.206501:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.206510:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.206515:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.206524:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.206541:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.206560:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ab29/0x8d0fd679423155fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.206582:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.206584:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.206585:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518364.206888:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518364.206895:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.206906:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1789518364.206909:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.206914:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.206937:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207012:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207022:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207045:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518364.207067:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518364.207076:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.207086:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518364.207090:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.207099:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.207115:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.207136:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315601 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.207155:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518364.207169:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518364.207171:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518364.207697:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518364.207705:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207715:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1789518364.207718:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.207723:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207734:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207742:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207761:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.207785:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518364.207813:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.207820:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.207830:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.207834:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.207844:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.207857:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.207865:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6426717/0x8d0fd67942315608 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.207893:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.207895:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.207897:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518364.208152:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518364.208158:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.208167:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1789518364.208170:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.208291:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.208304:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.208313:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.208320:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.208337:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789518364.209150:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518364.209160:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.209298:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1789518364.209302:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.209307:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.209318:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.209325:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.209331:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.209497:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789518364.211981:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518364.211996:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.212014:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=531s v=(0 0) 00010000:00010000:1.0:1789518364.212019:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.212025:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.212039:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.212069:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.212078:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.215966:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789518364.215987:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216003:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.216009:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216021:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216047:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216054:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541e164d/0x8d0fd6794231560f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216097:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518364.216101:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216107:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d200 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.216109:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216116:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216149:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216154:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8fb975f/0x8d0fd67942315616 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.216168:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.216171:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.217101:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.224623:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0ce00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.224631:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.224646:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.224668:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.230412:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518364.230422:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518364.230426:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518364.232504:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518364.232522:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac748027/0x8d0fd6794231561d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.232596:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.233253:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.233264:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233295:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.233300:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.233306:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233322:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233332:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233339:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233361:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518364.233646:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.233653:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233661:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.233664:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.233668:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233677:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233695:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.233702:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.234023:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789518364.234457:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.234479:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.234489:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.234492:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.234496:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.234505:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.234513:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.234519:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234587:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789518364.234595:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234603:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518364.234607:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234616:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234633:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234642:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c86cf8e6/0x8d0fd67942315624 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234670:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518364.234674:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234680:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518364.234683:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234690:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234701:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234708:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000629feb1f/0x8d0fd6794231562b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234719:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518364.234722:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234728:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518364.234731:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234749:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234759:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.234766:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518364.234768:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518364.234769:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.236113:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.238217:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789518364.238233:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd67942315632 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518364.239017:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.239028:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.239046:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.239051:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.239058:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.239074:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.239085:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.239092:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.241232:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.241248:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.241290:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9cc00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.241296:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.241308:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.241336:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.241349:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.241351:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.241352:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.244530:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789518364.244547:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315639 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.245287:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.245662:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.245671:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.245687:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.245692:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.245698:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.245712:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.245722:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.245728:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.245752:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518364.246100:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.246108:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.246117:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.246121:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.246131:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.246149:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.246165:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d09d5e96/0x8d0fd67942315640 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.246188:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.246190:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.246191:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.246563:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.246571:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.246581:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.246584:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.246596:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.246606:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.246614:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.246621:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.246642:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518364.247409:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.247418:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.247429:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9de00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.247434:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.247444:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.247460:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.247497:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e61b15a2/0x8d0fd67942315647 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.247523:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.247525:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.247526:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.247658:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.247665:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.247673:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.247676:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.247681:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.247691:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.247699:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.247715:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.247780:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518364.248324:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.248331:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.248341:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.248345:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.248350:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.248360:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.248369:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.248376:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251816:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518364.251833:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251848:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.251852:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251863:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251886:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251894:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003da0badc/0x8d0fd6794231564e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251925:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.251929:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251935:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.251938:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251958:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251988:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.251997:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.251998:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.252000:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.256802:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789518364.256817:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd67942315655 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.257029:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.258668:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.258693:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.258712:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.258717:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.258723:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.258738:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.258748:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.258754:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.258774:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518364.259147:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.259153:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259162:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.259165:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.259176:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259186:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259193:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259201:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259221:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789518364.259571:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.259578:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259587:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.259590:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.259594:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259603:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259611:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259629:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.259638:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789518364.260197:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789518364.260207:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260217:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.260222:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260233:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260252:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260259:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081e90879/0x8d0fd6794231565c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260300:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518364.260304:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260321:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ce00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.260325:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260333:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260343:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260350:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315663 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260365:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.260369:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260376:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.260379:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260386:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260396:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260410:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ff9a16/0x8d0fd6794231566a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.260426:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.260427:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.260429:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.260810:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.260818:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.260828:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.260832:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.260838:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.260850:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.260858:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.260865:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.261007:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.261098:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518364.262041:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518364.262049:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.262059:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518364.262062:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.262071:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.262086:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.262092:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d7171b/0x8d0fd67942315671 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.262119:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518364.262121:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518364.262123:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.263192:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.263203:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.263222:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.263227:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.263232:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.263244:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.263254:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.263260:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.263290:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518364.263996:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.264004:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.264014:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.264018:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.264027:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.264043:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.264050:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8c281cc/0x8d0fd67942315678 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.264072:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.264074:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.264075:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.264646:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.264655:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.264666:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.264670:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.265006:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265020:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265044:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265051:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265075:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518364.265564:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.265571:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.265580:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.265585:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.265593:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.265606:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.265613:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63b7913/0x8d0fd6794231567f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.265631:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.265633:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.265634:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.265873:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.265891:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265901:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.265905:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.265909:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265920:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265929:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.265937:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.268336:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518364.273365:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.273383:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.273403:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.273408:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.273415:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.273431:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.273443:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.273451:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276516:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518364.276531:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276542:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9dc00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.276547:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276575:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276599:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276607:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e4906f/0x8d0fd67942315686 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276643:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.276646:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276652:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.276655:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276661:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276670:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.276678:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.276680:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.276687:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.277024:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.277047:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789518364.277056:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218624e4/0x8d0fd6794231568d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518364.281287:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.281312:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.281344:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.281350:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.281357:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.281373:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.281384:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.281393:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.281427:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518364.282369:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.282381:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282393:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.282397:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.282401:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282412:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282436:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282444:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282493:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789518364.282509:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518364.282516:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282523:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9cc00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518364.282527:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282535:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282551:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282558:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000546d7104/0x8d0fd67942315694 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282580:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518364.282589:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282596:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d200 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518364.282599:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282607:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282617:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282625:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0f17b32/0x8d0fd6794231569b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.282639:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.282641:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.282642:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518364.284803:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.289823:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.289839:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.289859:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.289863:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.289870:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293394:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293409:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293418:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293449:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518364.293494:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518364.293503:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293511:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ca00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518364.293516:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293527:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293546:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293554:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e5ccab1/0x8d0fd679423156a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.293586:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.293588:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518364.293590:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518364.295274:0:18595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518364.295301:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.295319:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1789518364.295324:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518364.295330:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.295343:0:18595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.295353:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.295361:0:18595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518364.295389:0:18595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789518364.295457:0:18595:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1789518364.295586:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17115:x1876445522757504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 135860us (140332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518364.295595:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789518364.295696:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518364.295704:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.295712:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518364.295717:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.295727:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.295744:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.295752:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f700d091/0x8d0fd679423156a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.295777:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.295779:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518364.295781:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518364.297553:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17115:1876445522757504:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789518364.297575:0:17115:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789518364.297629:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17115:1876445522757632:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789518364.297857:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518364.297929:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730363f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518364.298105:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522757632 00000100:00100000:0.0:1789518364.298113:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522757632 00000100:00100000:0.0:1789518364.298167:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518364.298177:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17115:x1876445522757632:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789518364.298219:0:18597:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1789518364.311065:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789518364.311121:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789518364.311358:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17115:x1876445522757632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13177us (13497us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789518364.311372:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518364.311510:0:17115:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789518364.311519:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17115:1876445522757632:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789518364.311535:0:17115:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:2.0:1789518364.550028:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789518364.854567:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518364.885506:0:19409:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789518364.885511:0:19409:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789518364.885513:0:19409:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789518364.885767:0:19409:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e740d7b7800 00000020:01000004:0.0:1789518364.885787:0:19409:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789518364.885806:0:19409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789518364.885824:0:19409:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e74048299c0) 00000020:00000080:0.0:1789518364.885845:0:19409:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789518364.996262:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789518364.997583:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789518364.998447:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789518365.001591:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789518365.001925:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789518365.002513:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789518365.002858:0:19409:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1789518365.009006:0:19409:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789518365.010028:0:19409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789518365.010054:0:19409:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789518365.010090:0:19409:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8d0fd679423156b7 00000020:01000004:2.0:1789518365.010101:0:19409:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789518365.010131:0:19409:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789518365.010136:0:19409:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789518365.010143:0:19409:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789518365.010185:0:19409:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789518365.010191:0:19409:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789518365.065554:0:19409:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789518365.065618:0:19409:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.143@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789518365.065623:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789518365.065625:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518365.065627:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518365.065628:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518365.065629:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518365.065630:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518365.065632:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518365.065634:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518365.065635:0:19409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518365.065640:0:19409:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789518365.065642:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789518365.065644:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518365.065645:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518365.065646:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518365.065647:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518365.065648:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518365.065649:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518365.065650:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518365.065651:0:19409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518365.065687:0:19409:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789518365.065715:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522757760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789518365.065819:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.065948:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518365.076003:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522757760 00000100:00100000:2.0:1789518365.076028:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522757760 00000100:00100000:2.0:1789518365.076139:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789518365.076153:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:19409:x1876445522757760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518365.076239:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789518365.076248:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789518365.076253:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789518365.080292:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:19409:x1876445522757760:12345-0@lo:253:mount.lustre.0 Request processed in 4117us (14447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.080312:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789518365.081726:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522757760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789518365.081754:0:19409:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789518365.081759:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518365.081761:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518365.081763:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518365.081765:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518365.081766:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518365.081768:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518365.081769:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518365.081771:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518365.081794:0:19409:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789518365.081823:0:19409:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e740d7b7800 from lustre-OST0001 10000000:01000000:3.0:1789518365.081873:0:19409:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789518365.081877:0:19409:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789518365.081889:0:19409:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e73030e99c0 local copy 00010000:00010000:3.0:1789518365.081902:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518365.084827:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522757888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518365.085009:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.085223:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522757888 00000100:00100000:1.0:1789518365.085235:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522757888 00000100:00100000:1.0:1789518365.085320:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789518365.085333:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+21:19409:x1876445522757888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518365.085433:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+21:19409:x1876445522757888:12345-0@lo:501:mount.lustre.0 Request processed in 102us (495us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518365.085442:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789518365.088680:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.088747:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522757888:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789518365.088789:0:19409:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789518365.088848:0:19409:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789518365.088861:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.088875:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033adc00/0x8d0fd67942315306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231530d expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518365.088924:0:19409:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e740d7b7800 10000000:01000000:3.0:1789518365.088932:0:19409:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789518365.089138:0:19409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789518365.089144:0:19409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518365.089150:0:19409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789518365.089153:0:19409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789518365.089204:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd679423156be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.089212:0:19409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd679423156be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.089247:0:19409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd679423156be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518365.089283:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518365.089370:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.089415:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518365.089546:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758016 00000100:00100000:2.0:1789518365.089556:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758016 00000100:00100000:2.0:1789518365.089623:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789518365.089635:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:19409:x1876445522758016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518365.089652:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518365.089668:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ac800/0x8d0fd679423156c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423156be expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.089698:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ac800/0x8d0fd679423156c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423156be expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.089711:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ac800/0x8d0fd679423156c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423156be expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.089721:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac800, rc 0) 00000100:00100000:2.0:1789518365.089784:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758016:12345-0@lo:101:mount.lustre.0 Request processed in 151us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.089792:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789518365.089902:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518365.089919:0:19409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd679423156be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156c5 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518365.089930:0:19409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd679423156be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423156c5 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518365.091739:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789518365.092571:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518365.109017:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789518365.109120:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789518365.109142:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789518365.109160:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789518365.109175:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789518365.109188:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789518365.109221:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789518365.109227:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789518365.109425:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518365.109552:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.109609:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431570f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518365.111581:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758144 00000100:00100000:2.0:1789518365.111599:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758144 00000100:00100000:2.0:1789518365.111681:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789518365.111693:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518365.111971:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758144:12345-0@lo:501:mount.lustre.0 Request processed in 280us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.112002:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789518365.112263:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518365.112346:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518365.112412:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518365.112460:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b55c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.112598:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758272 00000100:00100000:3.0:1789518365.112605:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758272 00000100:00100000:3.0:1789518365.112644:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789518365.112652:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518365.125076:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758272:12345-0@lo:503:mount.lustre.0 Request processed in 12407us (12647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518365.125096:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789518365.125268:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518365.125911:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518365.126020:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518365.126094:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.126143:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74315706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.127604:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758400 00000100:00100000:3.0:1789518365.127622:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758400 00000100:00100000:3.0:1789518365.127703:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789518365.127714:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518365.131725:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758400:12345-0@lo:502:mount.lustre.0 Request processed in 4005us (5623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518365.131747:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789518365.131800:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518365.132196:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789518365.132235:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789518365.132251:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789518365.132263:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789518365.132292:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789518365.132307:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789518365.132320:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789518365.132838:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789518365.132858:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789518365.132911:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518365.133165:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.133205:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74315706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518365.133412:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758528 00000100:00100000:0.0:1789518365.133424:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758528 00000100:00100000:0.0:1789518365.133528:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789518365.133543:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518365.133730:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758528:12345-0@lo:502:mount.lustre.0 Request processed in 191us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518365.133740:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789518365.133985:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518365.134067:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789518365.134081:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789518365.148222:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789518365.148241:0:19413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789518365.148251:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518365.148254:0:19413:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789518365.148263:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518365.148295:0:19413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e743cdd19c0) 00000020:00000080:2.0:1789518365.148330:0:19413:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789518365.148337:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789518365.148492:0:19413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e740d7b7800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789518365.148503:0:19413:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789518365.148512:0:19413:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8d0fd679423156d3 00010000:00010000:2.0:1789518365.155376:0:19413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789518365.162867:0:19413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1789518365.172793:0:19413:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789518365.180490:0:19413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789518365.180504:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518365.180511:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518365.180513:0:19413:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789518365.180518:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518365.180522:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518365.180523:0:19413:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518365.180526:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518365.180528:0:19413:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518365.180531:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518365.180540:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518365.180542:0:19413:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789518365.180545:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518365.180548:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518365.180549:0:19413:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518365.180552:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789518365.180581:0:19413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518365.180584:0:19413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518365.180585:0:19413:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518365.180589:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789518365.180749:0:19409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789518365.180786:0:19409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789518365.180874:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd679423156be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156c5 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.180888:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400030a00/0x8d0fd679423156be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156c5 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518365.180897:0:19409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e740d7b7800 from 1 10000000:01000000:2.0:1789518365.180900:0:19409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518365.180937:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.180946:0:19409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.180967:0:19409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518365.180991:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518365.181608:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518365.181656:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7302391e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.182524:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758656 00000100:00100000:3.0:1789518365.182535:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758656 00000100:00100000:3.0:1789518365.182586:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789518365.182597:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:19409:x1876445522758656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518365.182613:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518365.182629:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423156da expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.182660:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423156da expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.182672:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423156da expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.182681:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031000, rc 0) 00000100:00100000:3.0:1789518365.182739:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522758656:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518365.182746:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789518365.183295:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518365.183314:0:19409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.183325:0:19409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518365.189385:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789518365.189876:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789518365.190097:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789518365.190120:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789518365.190135:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789518365.190139:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789518365.190213:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518365.190288:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518365.190329:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406d8dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.191704:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758784 00000100:00100000:3.0:1789518365.191716:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758784 00000100:00100000:3.0:1789518365.191769:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789518365.191791:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522758784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518365.191961:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522758784:12345-0@lo:501:mount.lustre.0 Request processed in 174us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518365.191970:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789518365.192588:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f93bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518365.192645:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518365.192704:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.192735:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74315706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518365.192929:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522758912 00000100:00100000:0.0:1789518365.192936:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522758912 00000100:00100000:0.0:1789518365.193112:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518365.193122:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522758912:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518365.193236:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522758912:12345-0@lo:503:mount.lustre.0 Request processed in 116us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518365.193244:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789518365.193393:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522758912:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518365.193843:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518365.193916:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518365.193973:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.194000:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74315706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518365.194659:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759040 00000100:00100000:0.0:1789518365.194668:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759040 00000100:00100000:0.0:1789518365.194754:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518365.194764:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522759040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518365.194911:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522759040:12345-0@lo:502:mount.lustre.0 Request processed in 148us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518365.194924:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789518365.195036:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518365.195223:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789518365.195250:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789518365.195264:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789518365.195295:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789518365.195309:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789518365.195322:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789518365.195350:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789518365.195366:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789518365.195393:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789518365.195409:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789518365.195422:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789518365.195447:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518365.195509:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.213220:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74315706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.213858:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759168 00000100:00100000:3.0:1789518365.213869:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759168 00000100:00100000:3.0:1789518365.213925:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518365.213937:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522759168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518365.218486:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522759168:12345-0@lo:502:mount.lustre.0 Request processed in 4518us (22943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.218501:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518365.218761:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518365.218865:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789518365.218886:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789518365.223299:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518365.223313:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223316:0:19417:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518365.223325:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e740d7b7800 00000020:00000080:0.0:1789518365.223329:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518365.223338:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518365.223340:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223342:0:19417:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789518365.223344:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518365.223346:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223347:0:19417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518365.223351:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e740d7b7800 00000020:00000080:0.0:1789518365.223353:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518365.223423:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518365.223427:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223429:0:19417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789518365.223431:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518365.223433:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223434:0:19417:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518365.223437:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e740d7b7800 00000020:00000080:0.0:1789518365.223439:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518365.223456:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518365.223459:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223460:0:19417:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518365.223487:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518365.223490:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223491:0:19417:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789518365.223494:0:19417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e740d7b7800 00000020:00000080:0.0:1789518365.223496:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518365.223519:0:19417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518365.223522:0:19417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518365.223535:0:19417:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789518365.223541:0:19417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789518365.224588:0:19409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789518365.224631:0:19409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518365.224653:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.225115:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518365.225175:0:19409:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789518365.225178:0:19409:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e740d7b7800 10000000:01000000:3.0:1789518365.225182:0:19409:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e740d7b7800 10000000:01000000:3.0:1789518365.225186:0:19409:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518365.225193:0:19409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e740d7b7800 from 1 10000000:01000000:3.0:1789518365.225195:0:19409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518365.225236:0:19409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030c00/0x8d0fd679423156e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.225254:0:19409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7400030c00/0x8d0fd679423156e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.225266:0:19409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7400030c00/0x8d0fd679423156e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518365.225303:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518365.225375:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.225579:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e730363fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518365.226794:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759296 00000100:00100000:0.0:1789518365.226811:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759296 00000100:00100000:0.0:1789518365.226894:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789518365.226907:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+23:19409:x1876445522759296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518365.226928:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518365.226948:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9d200/0x8d0fd679423156ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423156e8 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518365.226984:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9d200/0x8d0fd679423156ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423156e8 expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518365.227116:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9d200/0x8d0fd679423156ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423156e8 expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518365.227127:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d200, rc 0) 00000100:00100000:0.0:1789518365.227192:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759296:12345-0@lo:101:mount.lustre.0 Request processed in 288us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518365.227199:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789518365.227834:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518365.227854:0:19409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7400030c00/0x8d0fd679423156e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156ef expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.227864:0:19409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7400030c00/0x8d0fd679423156e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423156ef expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518365.230290:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789518365.231133:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518365.231367:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789518365.231557:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789518365.231573:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789518365.231584:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789518365.231596:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789518365.231607:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789518365.231619:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789518365.231630:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789518365.231641:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789518365.231652:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789518365.231757:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789518365.231773:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789518365.231785:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789518365.231796:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789518365.231823:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789518365.231836:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789518365.231848:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789518365.231860:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789518365.231872:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789518365.232112:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789518365.232131:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789518365.232144:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789518365.232157:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789518365.232169:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789518365.232180:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789518365.232193:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789518365.232205:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789518365.232220:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789518365.232233:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789518365.232246:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789518365.232282:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789518365.232300:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789518365.232314:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789518365.232327:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789518365.232339:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789518365.232352:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789518365.232364:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789518365.232538:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789518365.232563:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789518365.232578:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789518365.232592:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789518365.232605:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789518365.232618:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789518365.232641:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789518365.232656:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789518365.232874:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789518365.235106:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789518365.235126:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789518365.235256:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518365.235340:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.235615:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518365.241518:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759424 00000100:00100000:1.0:1789518365.241534:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759424 00000100:00100000:1.0:1789518365.241601:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789518365.241612:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518365.241823:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759424:12345-0@lo:501:mount.lustre.0 Request processed in 210us (6479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.241845:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789518365.242242:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518365.242306:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518365.242355:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.244677:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518365.245546:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759552 00000100:00100000:0.0:1789518365.245563:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759552 00000100:00100000:0.0:1789518365.245633:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518365.245644:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518365.245833:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759552:12345-0@lo:503:mount.lustre.0 Request processed in 190us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518365.245842:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518365.251201:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759552:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518365.251715:0:19409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518365.251811:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518365.251904:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.251955:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518365.257917:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759680 00000100:00100000:2.0:1789518365.257934:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759680 00000100:00100000:2.0:1789518365.258015:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789518365.258025:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518365.258200:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759680:12345-0@lo:502:mount.lustre.0 Request processed in 176us (6295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.258208:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789518365.258238:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518365.258560:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789518365.258594:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789518365.258611:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789518365.258626:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789518365.258641:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789518365.258654:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789518365.259089:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789518365.259109:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789518365.259125:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789518365.259151:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789518365.259168:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789518365.259181:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789518365.259209:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789518365.259224:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789518365.259237:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789518365.259248:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789518365.259262:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789518365.259290:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789518365.259304:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789518365.259317:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789518365.259328:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789518365.259342:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789518365.259354:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789518365.259368:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789518365.259561:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789518365.259580:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789518365.259593:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789518365.259607:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789518365.259634:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789518365.259648:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789518365.259968:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789518365.260065:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789518365.260087:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789518365.260100:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789518365.260117:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789518365.260128:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789518365.260140:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789518365.260152:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789518365.260166:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789518365.260177:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789518365.260190:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789518365.260203:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789518365.260229:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789518365.260243:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789518365.260278:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789518365.260296:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789518365.260309:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789518365.260321:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789518365.261797:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518365.261891:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.261938:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.261966:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759808 00000100:00100000:3.0:1789518365.261974:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759808 00000100:00100000:3.0:1789518365.263191:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789518365.263205:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518365.263370:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759808:12345-0@lo:502:mount.lustre.0 Request processed in 168us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518365.264148:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789518365.264237:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518365.265348:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789518365.268557:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789518365.268635:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518365.268742:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.268784:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7405282180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518365.268907:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522759936 00000100:00100000:1.0:1789518365.268917:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522759936 00000100:00100000:1.0:1789518365.268972:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789518365.268983:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518365.269110:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522759936:12345-0@lo:502:mount.lustre.0 Request processed in 129us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.269117:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789518365.270244:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522759936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518365.270326:0:19409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789518365.270337:0:19409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789518365.273092:0:19422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789518365.273110:0:19422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e740dd999c0) 00000020:00000080:1.0:1789518365.273135:0:19422:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789518365.273228:0:19422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e740d7b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789518365.273232:0:19422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e740d7b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789518365.273235:0:19422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e740d7b7800 3 00010000:00080000:1.0:1789518365.273264:0:19422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e74214d0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789518365.277968:0:19422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789518365.278283:0:19422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789518365.278350:0:19422:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518365.278364:0:19422:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8d0fd679423156fd 00000100:00080000:3.0:1789518365.278373:0:19422:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518365.278396:0:19422:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e74214d0800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518365.278443:0:19422:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303600380 x1876445522760064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518365.278506:0:19422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518365.278617:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522760064:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518365.280756:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.281121:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760064 00000100:00100000:3.0:1789518365.281132:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760064 00000100:00100000:3.0:1789518365.281178:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518365.281186:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522760064:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518365.281215:0:17091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1789518365.281252:0:17091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8d0fd67942315704 00000004:00100000:3.0:1789518365.281267:0:17091:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518365.281314:0:17091:0:(import.c:65:import_set_state_nolock()) ffff8e73020d4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518365.281392:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876445522760064:12345-0@lo:38:llog_process_th.0 Request processed in 205us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518365.281399:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1789518365.281528:0:19422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789518365.281544:0:19422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8e74317c8000) 00000020:00000080:3.0:1789518365.281565:0:19422:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789518365.281643:0:19422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e740d7b7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518365.281648:0:19422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e740d7b7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518365.281650:0:19422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e740d7b7800 3 00010000:00080000:3.0:1789518365.281688:0:19422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e73019ea800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.143@tcp at head 00010000:00080000:1.0:1789518365.283681:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303600380 x1876445522760064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518365.283697:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518365.283708:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789518365.283716:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518365.283722:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518365.283725:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e74214d0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518365.283731:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1876445522760064:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789518365.285573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518365.285580:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789518365.285584:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518365.285591:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:1.0:1789518365.285595:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789518365.285606:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7402e82000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518365.285627:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033e6d80 x1876445522760448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518365.285658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518365.286068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789518365.286070:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518365.286074:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 531 00000100:00080000:1.0:1789518365.286077:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789518365.286081:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7409e2b000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789518365.286097:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e73033e6300 x1876445522760960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518365.286156:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522760192:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.286222:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.286258:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522760832:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.286296:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.286322:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789518365.286328:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522760704:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.286349:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.286367:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522761344:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.287909:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.287983:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522760320:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.288366:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518365.288613:0:19422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789518365.288843:0:19422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789518365.288894:0:19422:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518365.288911:0:19422:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8d0fd67942315712 00000100:00080000:3.0:1789518365.288920:0:19422:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518365.288928:0:19422:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e73019ea800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789518365.288959:0:19422:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303602680 x1876445522761472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518365.288973:0:19422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789518365.289056:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522761088:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.289082:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.289103:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789518365.289109:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522760576:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.289144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.289162:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522761216:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.289182:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.289215:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760192 00000100:00100000:1.0:1789518365.289222:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760192 00000100:00100000:1.0:1789518365.289255:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760704 00000100:00100000:1.0:1789518365.289259:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760704 00000100:00100000:1.0:1789518365.289288:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518365.289296:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522760192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.289350:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522760192:12345-0@lo:400:kworker.0 Request processed in 54us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.289357:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518365.289375:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518365.289394:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522760704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.289425:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522760704:12345-0@lo:400:kworker.0 Request processed in 31us (3074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.289431:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518365.294588:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761344 00000100:00100000:2.0:1789518365.294605:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761344 00000100:00100000:2.0:1789518365.294668:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761088 00000100:00100000:2.0:1789518365.294672:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761088 00000100:00100000:2.0:1789518365.294686:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760576 00000100:00100000:2.0:1789518365.294689:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760576 00000100:00100000:2.0:1789518365.294699:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761216 00000100:00100000:2.0:1789518365.294702:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761216 00000100:00100000:2.0:1789518365.294719:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518365.294728:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522761344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518365.294830:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522761344:12345-0@lo:400:kworker.0 Request processed in 103us (6927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.294838:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518365.294854:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518365.294860:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522761088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518365.294890:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760832 00000100:00100000:0.0:1789518365.294896:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760832 00000100:00100000:2.0:1789518365.294913:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522761088:12345-0@lo:400:kworker.0 Request processed in 53us (5830us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518365.294914:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518365.294919:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789518365.294919:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518365.294931:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518365.294937:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522760576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518365.294962:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522760576:12345-0@lo:400:kworker.0 Request processed in 26us (5818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.294975:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518365.294986:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518365.294991:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522761216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518365.295017:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522761216:12345-0@lo:400:kworker.0 Request processed in 27us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.295022:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518365.295053:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522760448:0@lo:8:kworker.0 00000100:00100000:2.0:1789518365.295096:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518365.295120:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522760960:0@lo:8:kworker.0 00000100:00100000:2.0:1789518365.295142:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518365.295157:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1876445522761472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789518365.295181:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518365.295216:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760320 00000100:00100000:2.0:1789518365.295219:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760320 00000100:00100000:2.0:1789518365.295236:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760448 00000100:00100000:2.0:1789518365.295238:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760448 00000100:00100000:2.0:1789518365.295246:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522760960 00000100:00100000:2.0:1789518365.295248:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522760960 00000100:00100000:2.0:1789518365.295255:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518365.295261:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522760320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518365.295301:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522760320:12345-0@lo:400:kworker.0 Request processed in 40us (6936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.295306:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518365.295315:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518365.295319:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522760448:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789518365.295378:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522760448:12345-0@lo:8:kworker.0 Request processed in 57us (281us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789518365.295388:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518365.295399:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518365.295403:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522760960:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789518365.295433:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1876445522760960:12345-0@lo:8:kworker.0 Request processed in 28us (290us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789518365.295439:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518365.295452:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761472 00000100:00100000:2.0:1789518365.295455:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761472 00000100:00100000:2.0:1789518365.295492:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518365.295496:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1876445522761472:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789518365.295512:0:17091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1789518365.295547:0:17091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8d0fd67942315719 00000004:00100000:2.0:1789518365.295563:0:17091:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789518365.295594:0:17091:0:(import.c:65:import_set_state_nolock()) ffff8e730297f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518365.295624:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876445522761472:12345-0@lo:38:llog_process_th.0 Request processed in 127us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.295631:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518365.295663:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518365.295671:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518365.295675:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789518365.295679:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522760448:0@lo:8:kworker.0 00000100:00100000:2.0:1789518365.295688:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518365.295691:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518365.295694:0:3636:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789518365.295697:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522760960:0@lo:8:kworker.0 00010000:00080000:2.0:1789518365.295716:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e7303602680 x1876445522761472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518365.295725:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518365.295730:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789518365.295736:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789518365.295741:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789518365.295743:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e73019ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789518365.295747:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1876445522761472:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518365.296519:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e6a00 x1876445522760576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518365.296532:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522760576:0@lo:400:kworker.0 00010000:00080000:3.0:1789518365.296544:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e5880 x1876445522761216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518365.296552:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522761216:0@lo:400:kworker.0 00000100:00100000:3.0:1789518365.296565:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522760320:0@lo:400:kworker.0 00010000:00080000:3.0:1789518365.296575:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e6680 x1876445522761088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518365.296582:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522761088:0@lo:400:kworker.0 00000100:00080000:0.0:1789518365.297627:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518365.297681:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518365.297690:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522760832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518365.297760:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522760832:12345-0@lo:400:kworker.0 Request processed in 71us (11464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518365.297767:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518365.299622:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522760704:0@lo:400:kworker.0 00010000:00080000:1.0:1789518365.299655:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e73033e7480 x1876445522761344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518365.299675:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522761344:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.299689:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522760192:0@lo:400:kworker.0 00000100:00100000:1.0:1789518365.299702:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522760832:0@lo:400:kworker.0 00000040:00080000:3.0:1789518365.299907:0:19422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789518365.300040:0:19409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789518365.300069:0:19409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789518365.300083:0:19409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7400030c00/0x8d0fd679423156e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156ef expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518365.300094:0:19409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7400030c00/0x8d0fd679423156e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423156ef expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789518365.300149:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789518365.300152:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518365.300153:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518365.300154:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518365.300155:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518365.300157:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518365.300158:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518365.300160:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518365.300161:0:19409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789518365.300164:0:19409:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789518365.300167:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789518365.300168:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518365.300169:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518365.300170:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518365.300171:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518365.300172:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518365.300173:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518365.300174:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518365.300175:0:19409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789518365.300197:0:19409:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789518365.300213:0:19409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522761600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789518365.300283:0:19409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518365.300321:0:19409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406d8d900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518365.300342:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761600 00000100:00100000:3.0:1789518365.300349:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761600 00000100:00100000:3.0:1789518365.300546:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789518365.300556:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522761600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518365.300583:0:17083:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789518365.300596:0:17083:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789518365.307659:0:17083:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789518365.307684:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789518365.307715:0:17106:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518365.307727:0:17106:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518365.307762:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.307787:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 24 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.307796:0:17106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.307804:0:17106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.307862:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.307882:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 24 pid: 17083 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518365.307899:0:17106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522761728:0@lo:104: 00000100:00100000:1.0:1789518365.307998:0:17106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518365.308063:0:17106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 24 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.308083:0:17106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 24 pid: 17084 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518365.308093:0:17106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522761856:0@lo:104: 00000100:00100000:1.0:1789518365.308117:0:17106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518365.308349:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:19409:x1876445522761600:12345-0@lo:253:mount.lustre.0 Request processed in 7790us (8061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.308363:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789518365.308516:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761728 00000100:00100000:2.0:1789518365.308526:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761728 00000100:00100000:1.0:1789518365.308534:0:17106:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518365.310258:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761856 00000100:00100000:2.0:1789518365.310276:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761856 00000100:00100000:1.0:1789518365.310294:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518365.310318:0:17074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+4:17106:x1876445522761728:12345-0@lo:104: 00010000:00010000:1.0:1789518365.310344:0:17074:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310456:0:17074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518365.310485:0:17074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+4:17106:x1876445522761728:12345-0@lo:104: Request processed in 156us (2466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.310495:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518365.310529:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518365.310537:0:17074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522761856:12345-0@lo:104: 00010000:00010000:1.0:1789518365.310546:0:17074:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310583:0:17074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789518365.310594:0:17074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6224dd85-753f-4c3f-83da-7a6019473f75+3:17106:x1876445522761856:12345-0@lo:104: Request processed in 54us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.310601:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789518365.310627:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518365.310634:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310659:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:1.0:1789518365.310664:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310675:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518365.310684:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518365.310691:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518365.310737:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310745:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518365.310770:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310778:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423155d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423155d7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310797:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518365.310801:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310807:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6400 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:1.0:1789518365.310810:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310829:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518365.310836:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518365.310842:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518365.310860:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310867:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518365.310887:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310894:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6400/0x8d0fd679423155c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423155c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.310915:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518365.310917:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518365.310921:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518365.310929:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518365.310957:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522761984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518365.311005:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.311083:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518365.311094:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522762112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518365.311326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518365.311410:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522761984 00000100:00100000:1.0:1789518365.311419:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522761984 00010000:00010000:1.0:1789518365.311461:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 24 pid: 17083 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518365.311535:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522762112 00000100:00100000:1.0:1789518365.311539:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522762112 00010000:00010000:1.0:1789518365.311557:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 25 pid: 17084 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518365.311577:0:19409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6224dd85-753f-4c3f-83da-7a6019473f75:19409:1876445522761600:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518365.311577:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518365.311593:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+25:3638:x1876445522761984:12345-0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789518365.311603:0:19409:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789518365.311608:0:19409:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:1.0:1789518365.311609:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:01000004:3.0:1789518365.311621:0:19409:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00010000:00010000:1.0:1789518365.311621:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 25 pid: 17083 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789518365.311628:0:19409:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518365.311632:0:19409:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518365.311635:0:19409:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518365.311640:0:19409:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518365.311642:0:19409:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518365.311644:0:19409:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518365.311646:0:19409:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1789518365.311652:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 25 pid: 17083 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1789518365.311680:0:19409:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789518365.311681:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518365.311725:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+25:3638:x1876445522761984:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.311733:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518365.311756:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518365.311762:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+24:3640:x1876445522762112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518365.311770:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518365.311775:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 24 pid: 17084 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311784:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 24 pid: 17084 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311810:0:17075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311820:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518365.311837:0:17075:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004113366s 00010000:00010000:1.0:1789518365.311843:0:17075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311851:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311858:0:17075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311865:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311871:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518365.311876:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311884:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311893:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.311904:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518365.311932:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+24:3640:x1876445522762112:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.311946:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518365.311989:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6224dd85-753f-4c3f-83da-7a6019473f75:3640:1876445522762112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518365.312015:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522761984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518365.312038:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b7a00/0x8d0fd679423155d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423155d0 expref: 23 pid: 17083 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518365.312051:0:17106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522761728:0@lo:104: 00010000:00010000:1.0:1789518365.312061:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0c600/0x8d0fd679423155c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423155c2 expref: 22 pid: 17084 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518365.312070:0:17106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17106:1876445522761856:0@lo:104: 00010000:00010000:1.0:1789518365.312084:0:17106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.312094:0:17106:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.312100:0:17106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518365.312107:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0d400/0x8d0fd67942315720 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789518365.332586:0:19409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789518365.336756:0:19409:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789518365.336767:0:19409:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789518365.336822:0:19409:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789518365.336878:0:19409:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789518365.337047:0:19409:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789518365.337075:0:19409:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789518365.340373:0:19409:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789518365.341782:0:19409:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789518365.877850:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789518366.394254:0:19477:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789518366.394889:0:19477:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789518366.581538:0:17087:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789518366.581547:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e7303537800 from 10 10000000:01000000:1.0:1789518366.581553:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789518366.581609:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d200/0x8d0fd67942315727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518366.581630:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d200/0x8d0fd67942315727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518366.581642:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d200/0x8d0fd67942315727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518366.581673:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518366.581751:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518366.581798:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431570f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518366.581880:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522762240 00000100:00100000:2.0:1789518366.581888:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522762240 00000100:00100000:2.0:1789518366.581945:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518366.581954:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:17087:x1876445522762240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518366.581975:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518366.581989:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033ac600/0x8d0fd6794231572e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315727 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518366.582012:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ac600/0x8d0fd6794231572e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315727 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518366.582024:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033ac600/0x8d0fd6794231572e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315727 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518366.582033:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac600, rc 0) 00000100:00100000:2.0:1789518366.582070:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522762240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518366.582078:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789518366.582290:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518366.582308:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d200/0x8d0fd67942315727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231572e expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518366.582320:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d200/0x8d0fd67942315727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231572e expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518366.582375:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789518366.582405:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518366.582426:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7431570f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518366.589161:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522762368 00000100:00100000:2.0:1789518366.589178:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522762368 00000100:00100000:2.0:1789518366.589232:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789518366.589242:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522762368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789518366.589278:0:17083:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789518366.589294:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789518366.589297:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789518366.589446:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522762368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (7039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518366.589454:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789518366.596300:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789518366.596399:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518366.596410:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d200/0x8d0fd67942315727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231572e expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518366.596421:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d200/0x8d0fd67942315727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231572e expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518366.596445:0:17087:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789518366.596447:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e743f99c000 from 10 10000000:01000000:1.0:1789518366.596450:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789518366.596519:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd67942315735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518366.596527:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd67942315735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518366.596538:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd67942315735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518366.596562:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518366.596623:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518366.596669:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518366.599067:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522762496 00000100:00100000:3.0:1789518366.599082:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522762496 00000100:00100000:3.0:1789518366.599142:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789518366.599153:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522762496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518366.599170:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518366.599189:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400031400/0x8d0fd6794231573c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd67942315735 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.599216:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400031400/0x8d0fd6794231573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd67942315735 expref: 24 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.599227:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400031400/0x8d0fd6794231573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315735 expref: 24 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.599237:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031400, rc 0) 00000100:00100000:3.0:1789518366.599339:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522762496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (2715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.599348:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789518366.599408:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518366.599423:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd67942315735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231573c expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.599447:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd67942315735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd6794231573c expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518366.599529:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518366.599564:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518366.599584:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d81cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518366.599597:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522762624 00000100:00100000:3.0:1789518366.599600:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522762624 00000100:00100000:3.0:1789518366.599620:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789518366.599626:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522762624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789518366.599638:0:17082:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789518366.599654:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789518366.599657:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789518366.599727:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522762624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.599735:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789518366.599758:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522762624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518366.599809:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518366.599815:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd67942315735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231573c expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.599824:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f0d800/0x8d0fd67942315735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd6794231573c expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518366.903092:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518367.927759:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518368.246715:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518368.246740:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522762752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789518368.246814:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518368.247142:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522762752 00000100:00100000:3.0:1789518368.247151:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522762752 00000100:00100000:3.0:1789518368.247230:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518368.247240:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522762752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518368.247284:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789518368.247341:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522762752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518368.247348:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518368.247397:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522762752:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789518368.247494:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518368.759678:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522762880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518368.759761:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518368.759820:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522762880 00000100:00100000:1.0:1789518368.759828:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522762880 00000100:00100000:1.0:1789518368.759881:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518368.759891:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522762880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518368.759926:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789518368.759976:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522762880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518368.759998:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518368.760054:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522762880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518368.760380:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518368.760392:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522763008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518368.760428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518368.760694:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763008 00000100:00100000:0.0:1789518368.760700:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763008 00000100:00100000:0.0:1789518368.760814:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518368.760821:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522763008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518368.760844:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789518368.760883:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522763008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518368.760889:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518368.766578:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522763008:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789518368.954449:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518369.269804:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522763136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518369.269879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518369.269954:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763136 00000100:00100000:0.0:1789518369.269961:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763136 00000100:00100000:0.0:1789518369.270019:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518369.270028:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522763136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518369.270053:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789518369.270122:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522763136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518369.270130:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789518369.270163:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518369.270201:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522763136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518369.980290:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518370.807723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518370.807729:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789518370.807733:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518370.807751:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e7402e82000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518370.807778:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303f57480 x1876445522763648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518370.807815:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518370.807818:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789518370.807820:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518370.807826:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e7409e2b000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789518370.807836:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e7303f54e00 x1876445522764160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518370.807894:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522763776:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.807967:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808019:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522764416:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808064:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789518370.808070:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522763264:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808098:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808137:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522763904:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808179:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522764544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808216:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808254:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522763392:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808277:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808295:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522764032:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808316:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808333:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522764672:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808355:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808372:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789518370.808377:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522763520:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808396:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808411:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522764288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808427:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808436:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522764800:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808455:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518370.808515:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763264 00000100:00100000:0.0:1789518370.808524:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763264 00000100:00100000:0.0:1789518370.808570:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789518370.808579:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:3639:x1876445522763264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808636:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:3639:x1876445522763264:12345-0@lo:400:kworker.0 Request processed in 58us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.808642:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789518370.808672:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763904 00000100:00100000:0.0:1789518370.808676:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763904 00000100:00100000:0.0:1789518370.808700:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763392 00000100:00100000:0.0:1789518370.808702:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763392 00000100:00100000:0.0:1789518370.808714:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518370.808729:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522763904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808762:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522763904:12345-0@lo:400:kworker.0 Request processed in 34us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.808767:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518370.808778:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518370.808784:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522763392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808812:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522763392:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.808817:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518370.808837:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764032 00000100:00100000:0.0:1789518370.808841:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764032 00000100:00100000:0.0:1789518370.808871:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763520 00000100:00100000:0.0:1789518370.808874:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763520 00000100:00100000:0.0:1789518370.808890:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518370.808896:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522764032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808923:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522764032:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.808928:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518370.808939:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518370.808945:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522763520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.808968:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522763520:12345-0@lo:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.808972:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518370.808988:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763776 00000100:00100000:0.0:1789518370.808991:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763776 00000100:00100000:0.0:1789518370.809007:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764416 00000100:00100000:0.0:1789518370.809009:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764416 00000100:00100000:0.0:1789518370.809031:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764544 00000100:00100000:0.0:1789518370.809034:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764544 00000100:00100000:0.0:1789518370.809045:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764672 00000100:00100000:0.0:1789518370.809047:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764672 00000100:00100000:0.0:1789518370.809060:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764288 00000100:00100000:0.0:1789518370.809062:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764288 00000100:00100000:0.0:1789518370.809071:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764800 00000100:00100000:0.0:1789518370.809074:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764800 00000100:00100000:0.0:1789518370.809085:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518370.809090:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522763776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809118:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522763776:12345-0@lo:400:kworker.0 Request processed in 28us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.809123:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518370.809134:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518370.809140:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522764416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809162:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522764416:12345-0@lo:400:kworker.0 Request processed in 23us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.809167:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518370.809177:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518370.809183:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522764544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809206:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522764544:12345-0@lo:400:kworker.0 Request processed in 24us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.809211:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518370.809234:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518370.809240:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522764672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809264:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522764672:12345-0@lo:400:kworker.0 Request processed in 25us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.809277:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518370.809288:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518370.809293:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522764288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809319:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522764288:12345-0@lo:400:kworker.0 Request processed in 27us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.809325:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518370.809336:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518370.809343:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522764800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809366:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522764800:12345-0@lo:400:kworker.0 Request processed in 24us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518370.809372:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789518370.809398:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789518370.809401:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518370.809403:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518370.809435:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522763520:0@lo:400:kworker.0 00010000:00080000:0.0:1789518370.809447:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f4d880 x1876445522764288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518370.809456:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522764288:0@lo:400:kworker.0 00010000:00080000:0.0:1789518370.809488:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f4e300 x1876445522764800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518370.809496:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522764800:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522763392:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809515:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522764032:0@lo:400:kworker.0 00010000:00080000:0.0:1789518370.809531:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f4c380 x1876445522764672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518370.809539:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522764672:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809577:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522763264:0@lo:400:kworker.0 00000100:00100000:0.0:1789518370.809587:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522763904:0@lo:400:kworker.0 00010000:00080000:0.0:1789518370.809595:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f4fb80 x1876445522764544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518370.809603:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522764544:0@lo:400:kworker.0 00010000:00080000:0.0:1789518370.809611:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f55180 x1876445522763776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518370.809619:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522763776:0@lo:400:kworker.0 00010000:00080000:0.0:1789518370.809627:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f4c700 x1876445522764416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518370.809634:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522764416:0@lo:400:kworker.0 00000100:00100000:2.0:1789518370.809844:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522763648:0@lo:8:kworker.0 00000100:00100000:2.0:1789518370.809885:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.809904:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522764160:0@lo:8:kworker.0 00000100:00100000:2.0:1789518370.809924:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.809960:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522763648 00000100:00100000:2.0:1789518370.809965:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522763648 00000100:00100000:2.0:1789518370.809984:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764160 00000100:00100000:2.0:1789518370.809986:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764160 00000100:00100000:2.0:1789518370.809999:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518370.810003:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1876445522763648:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789518370.810028:0:18595:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:2.0:1789518370.810055:0:18595:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8d0fd67942315743 00002000:00100000:2.0:1789518370.810069:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e7302979800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789518370.810073:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789518370.810076:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789518370.810281:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789518370.810302:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8e730297b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518370.810341:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876445522763648:12345-0@lo:8:kworker.0 Request processed in 336us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.810347:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518370.810361:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518370.810365:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1876445522764160:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789518370.810380:0:18595:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:2.0:1789518370.810395:0:18595:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8d0fd6794231574a 00002000:00100000:2.0:1789518370.810400:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e730297a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789518370.810404:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789518370.810406:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789518370.810435:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789518370.810447:0:18595:0:(import.c:65:import_set_state_nolock()) ffff8e730297c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518370.810495:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1876445522764160:12345-0@lo:8:kworker.0 Request processed in 128us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.810501:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789518370.810526:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f57480 x1876445522763648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518370.810536:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789518370.810543:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789518370.810548:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789518370.810550:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7402e82000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789518370.810565:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789518370.810570:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1876445522763648:0@lo:8:kworker.0 00010000:00080000:2.0:1789518370.810581:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303f54e00 x1876445522764160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518370.810588:0:3636:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789518370.810593:0:3636:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789518370.810596:0:3636:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789518370.810598:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8e7409e2b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789518370.810608:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789518370.810612:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1876445522764160:0@lo:8:kworker.0 00000004:00080000:2.0:1789518370.810660:0:17117:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789518370.810677:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17117:1876445522765056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789518370.810700:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.810715:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417ce3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1789518370.810729:0:17116:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789518370.810793:0:17116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 538596328281ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789518370.810799:0:17116:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789518370.810831:0:17834:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789518370.810843:0:17834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17834:1876445522765312:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789518370.810864:0:17834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.810874:0:17834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74417cec00 going to sleep for 11 seconds 00000004:00080000:2.0:1789518370.810884:0:17833:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789518370.810926:0:17833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 538596461843ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789518370.810931:0:17833:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789518370.810949:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522765184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518370.810972:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.810990:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518370.810995:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522764928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518370.811013:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.811284:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765184 00000100:00100000:2.0:1789518370.811290:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765184 00000100:00100000:2.0:1789518370.811354:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522764928 00000100:00100000:2.0:1789518370.811358:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522764928 00000100:00100000:2.0:1789518370.811373:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518370.811379:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1876445522765184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518370.811397:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789518370.811451:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1876445522765184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.811457:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518370.811498:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518370.811505:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522764928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518370.811514:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789518370.811545:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876445522764928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.811550:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789518370.811652:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7435e92680 x1876445522764928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518370.811667:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522764928:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789518370.811677:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e7480 x1876445522765184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518370.811688:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522765184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518370.811746:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765056 00000100:00100000:2.0:1789518370.811750:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765056 00000100:00100000:2.0:1789518370.811765:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765312 00000100:00100000:2.0:1789518370.811768:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765312 00000100:00100000:2.0:1789518370.811777:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518370.811783:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17117:x1876445522765056:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789518370.811978:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518370.811986:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17834:x1876445522765312:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1789518370.812019:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789518370.814700:0:17822:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1789518370.814805:0:17070:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789518370.819357:0:19074:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789518370.819372:0:19074:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789518370.819380:0:19074:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:2.0:1789518370.821191:0:18596:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789518370.821200:0:18596:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789518370.822933:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17834:x1876445522765312:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10938us (12058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.822946:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789518370.823011:0:17834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e5c00 x1876445522765312/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518386 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518370.823054:0:17834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17834:1876445522765312:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789518370.823068:0:17834:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789518370.823113:0:17834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17834:1876445522765440:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789518370.823234:0:17834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.823257:0:17834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7420eca600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518370.823274:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765440 00000100:00100000:2.0:1789518370.823280:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765440 00000100:00100000:2.0:1789518370.823319:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518370.823328:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17834:x1876445522765440:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789518370.823353:0:18595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789518370.823384:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17834:x1876445522765440:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.823390:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789518370.823414:0:17834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e5c00 x1876445522765440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518386 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518370.823424:0:17834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17834:1876445522765440:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789518370.823645:0:17834:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789518370.823672:0:17834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17834:1876445522765568:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789518370.823698:0:17834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.823713:0:17834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7420eca600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518370.823727:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765568 00000100:00100000:2.0:1789518370.823730:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765568 00000100:00100000:2.0:1789518370.823754:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518370.823760:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17834:x1876445522765568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789518370.823809:0:18597:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1789518370.832071:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.832090:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.832114:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.832132:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.832141:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.832165:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.832178:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.832186:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.832225:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518370.832317:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518370.832330:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.832345:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518370.832350:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.832362:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.832392:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.832400:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081e90879/0x8d0fd67942315751 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.832427:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.832429:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.832431:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.834610:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.834630:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.834650:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.834655:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.834661:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.834676:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.834688:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.834695:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.834725:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.835005:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.835013:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.835024:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.835030:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.835185:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.835212:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.835232:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd67942315758 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.835255:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.835258:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.835260:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.835757:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.835764:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835774:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.835777:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.835783:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835793:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835809:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835817:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835834:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518370.835843:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518370.835847:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835854:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518370.835858:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835866:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835878:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835899:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd6794231575f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.835913:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.835921:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.835923:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.837596:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.837609:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.837626:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.837630:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.837636:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.837649:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.837659:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.837668:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.837696:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518370.837788:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518370.837802:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.837817:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0dc00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518370.837824:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.837837:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.837861:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.837884:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd67942315766 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.837917:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518370.837920:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518370.837922:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518370.841056:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.841075:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.841096:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.841102:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.841109:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.841138:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.841152:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.841161:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.841196:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518370.841267:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518370.841281:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.841296:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518370.841301:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.841314:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.841342:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.841351:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d7171b/0x8d0fd6794231576d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.841400:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518370.841402:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518370.841404:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518370.846526:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.846555:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846580:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.846586:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.846595:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846616:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846631:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846640:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846666:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518370.846685:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518370.846698:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846707:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518370.846713:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846723:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846750:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.846756:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003da0badc/0x8d0fd67942315774 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.847080:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518370.847083:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518370.847085:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518370.847702:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.847710:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.847720:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.847723:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.847734:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.847743:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.847749:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.847754:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.847869:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.847903:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.847920:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.847937:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9de00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.847944:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.847968:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.847995:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.848004:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e61b15a2/0x8d0fd6794231577b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.848027:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.848029:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.848031:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518370.848301:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.848309:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.848319:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.848323:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.848327:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.848338:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.848347:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.848354:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.848375:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.848460:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.848501:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.848513:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.848517:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.848526:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.848541:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.848563:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09d5e96/0x8d0fd67942315782 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.848581:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.848582:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.848584:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518370.849084:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.849094:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849107:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.849121:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.849127:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849139:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849148:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849156:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849175:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.849249:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.849258:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.849269:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ce00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.849273:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.849283:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.849299:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.849307:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cedd34e5/0x8d0fd67942315789 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.849329:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.849332:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.849333:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518370.849609:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.849618:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849629:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.849633:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.849637:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849651:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849663:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.849679:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.850018:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518370.850377:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518370.850389:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.850400:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518370.850405:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.850415:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.850430:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.850438:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8ff9a16/0x8d0fd67942315790 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.850498:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518370.850501:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518370.850503:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.856072:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.856094:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.856120:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.856126:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.856133:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.856161:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.856174:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.856183:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.856212:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.856585:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.856606:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.856622:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.856629:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.856641:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.856666:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.856674:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd67942315797 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.856699:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.856700:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.856702:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.859968:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.859988:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860011:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.860017:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.860025:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860041:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860050:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860066:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860084:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518370.860100:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518370.860106:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860114:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518370.860119:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860129:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860150:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860156:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd6794231579e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860172:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.860174:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.860175:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518370.864661:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789518370.864678:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.864753:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789518370.864759:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518370.864766:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.864829:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.864842:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.864851:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.864873:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518370.866498:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518370.866512:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.866539:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518370.866544:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.866555:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.866577:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.866584:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8c281cc/0x8d0fd679423157a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.866612:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518370.866614:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518370.866616:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.872560:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.872589:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.872613:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.872618:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.872627:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.872644:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.872657:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.872666:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.873851:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518370.874270:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518370.874282:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.874305:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518370.874310:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.874323:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.874347:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.874355:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518370.874382:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518370.874384:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518370.874386:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789518370.875893:0:19410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789518370.875933:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789518370.875939:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789518370.876066:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.876078:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876099:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.876105:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.876120:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876137:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876149:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876157:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876178:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518370.876191:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518370.876197:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876205:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518370.876210:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876230:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876247:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876267:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.876288:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.876290:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.876292:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.878098:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.878115:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.878136:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.878140:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.878148:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.878161:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.878171:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.878179:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.878203:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518370.878669:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17834:x1876445522765568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54899us (54960us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789518370.878681:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518370.878728:0:17834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789518370.878734:0:17834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17834:1876445522765568:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789518370.878753:0:17834:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789518370.878803:0:17834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17834:1876445522765696:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789518370.878853:0:17834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.878876:0:17834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7410c25b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518370.878911:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765696 00000100:00100000:2.0:1789518370.878918:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765696 00000100:00100000:2.0:1789518370.878960:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518370.878969:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17834:x1876445522765696:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789518370.879001:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17834:x1876445522765696:12345-0@lo:900:osp-pre-1-1.0 Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.879005:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789518370.879024:0:17834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e73033e5c00 x1876445522765696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789518386 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518370.879032:0:17834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17834:1876445522765696:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1789518370.879131:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518370.879147:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.879159:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518370.879164:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.879174:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.879197:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.879206:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ff3479a/0x8d0fd679423157ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.879236:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.879239:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.879241:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.880574:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.880589:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.880606:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.880611:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.880618:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.880645:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.880658:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.880667:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.880864:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.881052:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.881069:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.881084:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0ce00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.881089:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.881102:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.881125:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.881153:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac748027/0x8d0fd679423157c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.881182:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.881185:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.881187:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.883907:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.883928:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.883949:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.883954:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.883962:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.883979:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.883993:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.884013:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.884047:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.884094:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.884110:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884127:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c600 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.884132:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884143:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884167:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884176:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b8621b1/0x8d0fd679423157c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884228:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.884230:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.884232:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.884647:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.884655:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.884666:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.884669:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.884674:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.884839:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.884849:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.884856:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.884878:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.884907:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.884914:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884924:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.884928:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884937:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884953:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884960:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047cf84ac/0x8d0fd679423157cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.884994:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.884996:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.884998:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.886358:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.886369:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.886394:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.886398:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.886405:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.886420:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.886431:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.886440:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.886482:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.886533:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.886548:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.886563:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.886568:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.886603:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.886621:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.886629:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e82584d/0x8d0fd679423157d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.886656:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.886658:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.886660:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.886870:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.886878:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.889969:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.889976:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.889986:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.890009:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.890052:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.890061:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.890097:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.890149:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.890166:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.890182:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0dc00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.890187:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.890199:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.890233:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.890266:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003695c702/0x8d0fd679423157dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.890296:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.890297:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.890298:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.891975:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.891992:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.892011:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.892016:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.892023:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.892038:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.892048:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.892057:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.892096:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.892588:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.892599:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.892609:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.892612:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.892620:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.892634:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.892639:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6426717/0x8d0fd679423157e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.892676:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.892679:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.892680:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.892951:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.892960:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.892973:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.892976:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.892981:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.892993:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893003:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893011:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893033:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.893065:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.893074:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893084:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.893089:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893101:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893114:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893122:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f29f5cd/0x8d0fd679423157eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893144:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.893146:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.893149:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.893386:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.893393:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893404:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.893413:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.893418:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893427:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893436:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893443:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.893478:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.893504:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.893512:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893520:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.893524:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893549:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893563:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893571:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a8ab29/0x8d0fd679423157f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.893586:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.893588:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.893589:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.895532:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.895555:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.895580:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.895585:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.895594:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.895612:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.895624:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.895654:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.895682:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.896116:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.896131:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.896145:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7a00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.896149:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.896160:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.896180:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.896213:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.896215:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.896229:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518370.898085:0:19074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000481934ca/0x8d0fd679423157f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518370.899843:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.899861:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.899955:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.899961:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.899969:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.899989:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.900002:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.900012:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.900055:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518370.900098:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.900242:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.900259:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.900264:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.900277:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.900299:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.900306:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095d269b5/0x8d0fd67942315800 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.900338:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.900340:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.900342:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518370.901198:0:19074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789518370.901210:0:19074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.901235:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789518370.901239:0:19074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.901244:0:19074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.901257:0:19074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.901266:0:19074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.901275:0:19074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.901306:0:19074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789518370.901363:0:19074:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1789518370.901520:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17117:x1876445522765056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89729us (90811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518370.901533:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518370.901643:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17117:1876445522765056:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789518370.901668:0:17117:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789518370.901733:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17117:1876445522765824:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789518370.901774:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518370.901813:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74416b4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518370.901836:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765824 00000100:00100000:3.0:1789518370.901844:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765824 00000100:00100000:3.0:1789518370.901890:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518370.901899:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17117:x1876445522765824:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789518370.901968:0:18595:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1789518370.902823:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518370.902838:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.902878:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6c00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518370.902885:0:17078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.902900:0:17078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.902924:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.902933:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abe1073/0x8d0fd67942315807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.902961:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.902963:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518370.902966:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518370.907497:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17117:x1876445522765824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5559us (5684us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789518370.907515:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518370.907725:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17117:1876445522765824:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789518370.907750:0:17117:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789518371.002301:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518371.510177:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789518372.026024:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518372.884266:0:19766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789518373.046935:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518373.365698:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522765952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789518373.365789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518373.365853:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522765952 00000100:00100000:2.0:1789518373.365868:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522765952 00000100:00100000:2.0:1789518373.365959:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518373.365974:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522765952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518373.366148:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518373.366252:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522765952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 283us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518373.366261:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518373.366723:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522765952:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789518373.366878:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518373.882169:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522766080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518373.882298:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518373.882394:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766080 00000100:00100000:1.0:1789518373.882405:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766080 00000100:00100000:1.0:1789518373.882496:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518373.882508:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522766080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789518373.882557:0:17830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789518373.882616:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522766080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518373.882624:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518373.882683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522766080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518373.882876:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522766208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518373.882912:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518373.882955:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766208 00000100:00100000:3.0:1789518373.882960:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766208 00000100:00100000:3.0:1789518373.882986:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518373.882993:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522766208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518373.883016:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789518373.883054:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522766208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518373.883060:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518373.883089:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522766208:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1789518373.974926:0:19819:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789518373.975696:0:19819:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518374.070966:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518374.390333:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518374.390367:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522766336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518374.390505:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518374.390609:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766336 00000100:00100000:2.0:1789518374.390620:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766336 00000100:00100000:2.0:1789518374.390707:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518374.390720:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522766336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518374.390752:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518374.390819:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522766336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518374.390827:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789518374.391178:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518374.391238:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e73033e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522766336:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789518374.774580:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789518374.848398:0:19869:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789518374.849062:0:19869:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789518375.093886:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518375.135610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.135723:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501704704 00000100:00100000:3.0:1789518375.135734:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501704704 00000100:00100000:3.0:1789518375.135785:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:3.0:1789518375.135795:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2386:x1876445501704704:12345-192.168.202.43@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789518375.135825:0:17084:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f38d0052-52dc-405f-a9d4-0f80e8f0dd25@192.168.202.43@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1789518375.135856:0:17084:0:(genops.c:1384:class_connect()) connect: client f38d0052-52dc-405f-a9d4-0f80e8f0dd25, cookie 0x8d0fd6794231580e 00000100:00080000:3.0:1789518375.136001:0:17084:0:(import.c:65:import_set_state_nolock()) ffff8e7302b97800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518375.136090:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+5:2386:x1876445501704704:12345-192.168.202.43@tcp:250:mount.lustre.0 Request processed in 295us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.136097:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:3.0:1789518375.157787:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.157906:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501704832 00000100:00100000:0.0:1789518375.157917:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501704832 00000100:00100000:0.0:1789518375.157981:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:0.0:1789518375.157992:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+5:14863:x1876445501704832:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518375.158009:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518375.158027:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9c000/0x8d0fd67942315815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566494 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.158059:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9c000/0x8d0fd67942315815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566494 expref: 6 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.158070:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9c000/0x8d0fd67942315815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566494 expref: 6 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.158079:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c000, rc 0) 00000100:00100000:0.0:1789518375.158144:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+6:14863:x1876445501704832:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.158151:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:1.0:1789518375.162908:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.166768:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501704960 00000100:00100000:0.0:1789518375.166785:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501704960 00000100:00100000:0.0:1789518375.166881:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:0.0:1789518375.166893:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+6:14863:x1876445501704960:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518375.167034:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+6:14863:x1876445501704960:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 143us (4135us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518375.167043:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:2.0:1789518375.190794:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.190895:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705088 00000100:00100000:3.0:1789518375.190905:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705088 00000100:00100000:3.0:1789518375.190965:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:3.0:1789518375.190974:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+6:14863:x1876445501705088:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518375.190991:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518375.191009:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400031a00/0x8d0fd6794231581c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856649b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518375.191052:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400031a00/0x8d0fd6794231581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856649b expref: 7 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518375.191064:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400031a00/0x8d0fd6794231581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856649b expref: 7 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518375.191073:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031a00, rc 0) 00000100:00100000:3.0:1789518375.191137:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+7:14863:x1876445501705088:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 164us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.191160:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:2.0:1789518375.197455:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.197749:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705216 00000100:00100000:3.0:1789518375.197761:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705216 00000100:00100000:3.0:1789518375.197831:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:3.0:1789518375.197841:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+7:14863:x1876445501705216:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789518375.198019:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14863:x1876445501705216:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 179us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.198027:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:1.0:1789518375.200116:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.200240:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705344 00000100:00100000:0.0:1789518375.200250:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705344 00000100:00100000:0.0:1789518375.200348:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:0.0:1789518375.200359:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14863:x1876445501705344:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518375.200517:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14863:x1876445501705344:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.200525:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:2.0:1789518375.206793:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.207318:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705472 00000100:00100000:0.0:1789518375.207330:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705472 00000100:00100000:0.0:1789518375.207828:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:0.0:1789518375.207839:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14882:x1876445501705472:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518375.208002:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14882:x1876445501705472:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 165us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.208009:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:2.0:1789518375.242070:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.242229:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705600 00000100:00100000:0.0:1789518375.242239:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705600 00000100:00100000:0.0:1789518375.242301:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:0.0:1789518375.242312:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14882:x1876445501705600:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518375.242523:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14882:x1876445501705600:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 212us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.242532:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:1.0:1789518375.250222:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.250705:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705728 00000100:00100000:0.0:1789518375.250717:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705728 00000100:00100000:0.0:1789518375.250828:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:0.0:1789518375.250839:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14882:x1876445501705728:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518375.251004:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14882:x1876445501705728:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 166us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.251022:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:2.0:1789518375.254621:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.259517:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705856 00000100:00100000:3.0:1789518375.259532:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705856 00000100:00100000:2.0:1789518375.259767:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:2.0:1789518375.259789:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+8:14863:x1876445501705856:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789518375.259807:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518375.259826:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e73033aca00/0x8d0fd67942315823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785664cc expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518375.259867:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033aca00/0x8d0fd67942315823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664cc expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518375.259878:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e73033aca00/0x8d0fd67942315823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664cc expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518375.259887:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033aca00, rc 0) 00000100:00100000:2.0:1789518375.259951:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+9:14863:x1876445501705856:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 164us (5339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518375.259974:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:2.0:1789518375.264108:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.264221:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501705984 00000100:00100000:0.0:1789518375.264288:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501705984 00000100:00100000:0.0:1789518375.264345:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:0.0:1789518375.264356:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+9:14863:x1876445501705984:12345-192.168.202.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789518375.264386:0:17084:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789518375.264412:0:17084:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789518375.264416:0:17084:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789518375.264419:0:17084:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789518375.264422:0:17084:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789518375.264424:0:17084:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789518375.265936:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+9:14863:x1876445501705984:12345-192.168.202.43@tcp:256:mount.lustre.0 Request processed in 1573us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.265951:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:2.0:1789518375.268057:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.268113:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501706112 00000100:00100000:0.0:1789518375.268121:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501706112 00000100:00100000:0.0:1789518375.268162:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 127 00000100:00100000:0.0:1789518375.268171:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743ac21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+9:14863:x1876445501706112:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518375.268200:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518375.268217:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785664d3 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.268295:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.268307:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.268326:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9cc00, rc 0) 00000100:00100000:0.0:1789518375.268382:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743ac21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14863:x1876445501706112:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 212us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.268389:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 127 00000100:00100000:2.0:1789518375.269986:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.270040:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501706240 00000100:00100000:0.0:1789518375.270048:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501706240 00000100:00100000:0.0:1789518375.270099:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 128 00000100:00100000:0.0:1789518375.270108:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14863:x1876445501706240:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518375.270322:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14863:x1876445501706240:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 214us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.270330:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 128 00000100:00100000:1.0:1789518375.272445:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.272561:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501706368 00000100:00100000:0.0:1789518375.272570:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501706368 00000100:00100000:0.0:1789518375.272624:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:0.0:1789518375.272634:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14863:x1876445501706368:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518375.272792:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14863:x1876445501706368:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 158us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.272799:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:2.0:1789518375.276208:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.276559:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501706496 00000100:00100000:0.0:1789518375.276572:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501706496 00000100:00100000:0.0:1789518375.276641:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:0.0:1789518375.276656:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743b4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14886:x1876445501706496:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518375.276865:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743b4ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14886:x1876445501706496:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 213us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.276882:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:2.0:1789518375.280088:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.280186:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501706624 00000100:00100000:3.0:1789518375.280197:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501706624 00000100:00100000:3.0:1789518375.280264:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:3.0:1789518375.280274:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14886:x1876445501706624:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518375.280436:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14886:x1876445501706624:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 163us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.280443:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:1.0:1789518375.297437:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.298104:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501706752 00000100:00100000:0.0:1789518375.298115:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501706752 00000100:00100000:0.0:1789518375.298171:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789518375.298190:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1876445501706752:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518375.298221:0:17090:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23@192.168.202.43@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1789518375.298291:0:17090:0:(genops.c:1384:class_connect()) connect: client d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23, cookie 0x8d0fd67942315831 00000004:00100000:0.0:1789518375.298318:0:17090:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518375.298575:0:17090:0:(import.c:65:import_set_state_nolock()) ffff8e73028d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518375.298657:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2386:x1876445501706752:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 465us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.298664:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:2.0:1789518375.308851:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518375.308903:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.308999:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707008 00000100:00100000:3.0:1789518375.309012:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707008 00000100:00100000:3.0:1789518375.309062:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501706880 00000100:00100000:3.0:1789518375.309065:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501706880 00000100:00100000:3.0:1789518375.309114:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:3.0:1789518375.309122:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1876445501707008:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789518375.309155:0:19376:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23@192.168.202.43@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1789518375.309217:0:19376:0:(genops.c:1384:class_connect()) connect: client d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23, cookie 0x8d0fd67942315838 00000004:00100000:3.0:1789518375.309254:0:19376:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789518375.309456:0:19376:0:(import.c:65:import_set_state_nolock()) ffff8e730296c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518375.309549:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2386:x1876445501707008:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 426us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.309557:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:3.0:1789518375.309574:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:3.0:1789518375.309580:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:0:x1876445501706880:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789518375.309606:0:19376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789518375.309662:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:0:x1876445501706880:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 81us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.309668:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00080000:2.0:1789518375.310325:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518375.313219:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518375.313307:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707264 00000100:00100000:2.0:1789518375.313318:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707264 00000100:00100000:2.0:1789518375.313378:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789518375.313388:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707264:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789518375.313417:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789518375.314978:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707264:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 1584us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518375.314990:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:0.0:1789518375.330115:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.340095:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707136 00000100:00100000:3.0:1789518375.340112:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707136 00000100:00080000:0.0:1789518375.340164:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518375.340202:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:3.0:1789518375.340213:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:0:x1876445501707136:12345-192.168.202.43@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789518375.340297:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518375.340895:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707392 00000100:00100000:1.0:1789518375.340903:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707392 00000100:00100000:1.0:1789518375.340948:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789518375.340956:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707392:12345-192.168.202.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789518375.341040:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707392:12345-192.168.202.43@tcp:40:mount.lustre.0 Request processed in 83us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518375.341048:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000004:00000024:3.0:1789518375.343239:0:19376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789518375.345193:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:0:x1876445501707136:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 4967us (15074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.345199:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.345208:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:0.0:1789518375.345338:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.345361:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518375.345776:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707520 00000100:00100000:2.0:1789518375.345786:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707520 00000100:00100000:2.0:1789518375.345827:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707648 00000100:00100000:2.0:1789518375.345830:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707648 00000100:00100000:2.0:1789518375.345855:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789518375.345863:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876445501707520:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789518375.345895:0:18597:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23@192.168.202.43@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1789518375.345925:0:18597:0:(genops.c:1384:class_connect()) connect: client d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23, cookie 0x8d0fd6794231583f 00002000:00100000:2.0:1789518375.345951:0:18597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23/ffff8e730304d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789518375.345969:0:18597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789518375.346103:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707776 00000100:00100000:1.0:1789518375.346109:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707776 00002000:00080000:2.0:1789518375.346137:0:18597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789518375.346142:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789518375.346156:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707776:12345-192.168.202.43@tcp:900:mount.lustre.0 00000100:00080000:2.0:1789518375.346167:0:18597:0:(import.c:65:import_set_state_nolock()) ffff8e730304f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518375.346222:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707776:12345-192.168.202.43@tcp:900:mount.lustre.0 Request processed in 64us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518375.346238:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:0.0:1789518375.346266:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:0.0:1789518375.346276:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1876445501707648:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789518375.346294:0:18596:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23@192.168.202.43@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1789518375.346315:0:18596:0:(genops.c:1384:class_connect()) connect: client d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23, cookie 0x8d0fd67942315846 00002000:00100000:0.0:1789518375.346320:0:18596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23/ffff8e73028d6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518375.346332:0:18596:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789518375.346456:0:18596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1789518375.346827:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2386:x1876445501707520:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 961us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518375.353295:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518375.353450:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501707904 00000100:00100000:3.0:1789518375.353491:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501707904 00000100:00100000:3.0:1789518375.353543:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:3.0:1789518375.353553:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707904:12345-192.168.202.43@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789518375.354335:0:17093:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 658us 00000100:00080000:0.0:1789518375.354642:0:18596:0:(import.c:65:import_set_state_nolock()) ffff8e73028d4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518375.354710:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2386:x1876445501707648:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 8436us (9346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.354721:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789518375.354904:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000004:00200000:0.0:1789518375.389367:0:17093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789518375.390310:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14863:x1876445501707904:12345-192.168.202.43@tcp:33:mount.lustre.0 Request processed in 36749us (37015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.390327:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:1.0:1789518375.595421:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518375.595572:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708032 00000100:00100000:0.0:1789518375.595583:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708032 00000100:00100000:0.0:1789518375.595662:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:0.0:1789518375.595955:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14909:x1876445501708032:12345-192.168.202.43@tcp:101:mkdir.0 00010000:00010000:0.0:1789518375.595978:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518375.596004:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd6794231584d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566504 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.596087:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd67942315854 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.596102:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd67942315854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.596119:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd67942315854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518375.596171:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789518375.596186:0:17091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518375.596225:0:17091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd67942315854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.596274:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd6794231584d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566504 expref: 8 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.596296:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd67942315854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566504 expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518375.596305:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:0.0:1789518375.596308:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518375.596312:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c800, rc 0) 00000100:00100000:0.0:1789518375.596386:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:14909:x1876445501708032:12345-192.168.202.43@tcp:101:mkdir.0 Request processed in 713us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.596394:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789518375.925709:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518375.925741:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522766464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518375.925818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.925895:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766464 00000100:00100000:2.0:1789518375.925904:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766464 00000100:00100000:2.0:1789518375.925961:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518375.925971:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522766464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518375.925992:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1789518375.926829:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518375.927693:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522766464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1721us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518375.927705:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518375.928186:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522766848:0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.928239:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518375.928454:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522766720:0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.928509:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518375.928540:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.928563:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518375.928581:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522767744:0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.928599:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518375.928630:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522767232 00000100:00100000:0.0:1789518375.928638:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522767232 00000100:00100000:0.0:1789518375.928676:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522767744 00000100:00100000:0.0:1789518375.928679:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522767744 00000100:00100000:0.0:1789518375.928732:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518375.928741:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.928786:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876445522767232:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.928799:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518375.928814:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518375.928820:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522767744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.928849:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876445522767744:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.928854:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518375.928890:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876445522767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.928900:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1876445522767744:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.929424:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522766976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.929459:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.929509:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522767488:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.929529:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.929547:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522768000:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.929569:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.929585:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789518375.929590:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522766592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518375.929621:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.929636:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522767104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.929652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.929666:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522767616:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.929685:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.929699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522768128:0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.929903:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522767360:0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.929928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518375.929944:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522767872:0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.929973:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766848 00000100:00100000:3.0:1789518375.929980:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766848 00000100:00100000:3.0:1789518375.930012:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522767360 00000100:00100000:3.0:1789518375.930015:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522767360 00000100:00100000:3.0:1789518375.930046:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789518375.930053:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522766848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.930097:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522766848:12345-0@lo:400:kworker.0 Request processed in 45us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.930104:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789518375.930119:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518375.930124:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522767360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.930149:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522767360:12345-0@lo:400:kworker.0 Request processed in 26us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.930154:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518375.930211:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766720 00000100:00100000:3.0:1789518375.930215:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766720 00000100:00100000:3.0:1789518375.930253:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789518375.930261:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:3639:x1876445522766720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.930299:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:3639:x1876445522766720:12345-0@lo:400:kworker.0 Request processed in 40us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518375.930305:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789518375.930766:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766592 00000100:00100000:1.0:1789518375.930771:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766592 00000100:00100000:1.0:1789518375.930803:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518375.930810:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522766592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518375.930825:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789518375.930860:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522766592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518375.930866:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789518375.930885:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518375.930889:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518375.930899:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522766976 00000100:00100000:1.0:1789518375.930902:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522766976 00000100:00100000:1.0:1789518375.930925:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522767488 00000100:00100000:1.0:1789518375.930929:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522767488 00000100:00100000:1.0:1789518375.930946:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522767104 00000100:00100000:1.0:1789518375.930948:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522767104 00000100:00100000:1.0:1789518375.930958:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518375.930964:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522766976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518375.930994:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522766976:12345-0@lo:400:kworker.0 Request processed in 31us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518375.931000:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518375.931032:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518375.931038:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522767488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518375.931067:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522767488:12345-0@lo:400:kworker.0 Request processed in 30us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518375.931072:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518375.931083:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518375.931089:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522767104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518375.931115:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1876445522767104:12345-0@lo:400:kworker.0 Request processed in 26us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518375.931120:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789518375.931138:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518375.931184:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522766464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518375.932273:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768000 00000100:00100000:0.0:1789518375.932284:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768000 00000100:00100000:0.0:1789518375.932341:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522767616 00000100:00100000:0.0:1789518375.932344:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522767616 00000100:00100000:0.0:1789518375.932363:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518375.932372:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522768000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.932434:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876445522768000:12345-0@lo:400:kworker.0 Request processed in 63us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.932442:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518375.932457:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518375.932497:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522767616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518375.932525:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522767616:12345-0@lo:400:kworker.0 Request processed in 63us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518375.932531:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518375.932567:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.932741:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518375.932790:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522766976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.932802:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522767488:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.932813:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1876445522768000:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.932841:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522766592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518375.932850:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522767104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.932860:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522767616:0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.934420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518375.934531:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522766848:0@lo:400:kworker.0 00000100:00100000:3.0:1789518375.934547:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522767360:0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.934639:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768128 00000100:00100000:2.0:1789518375.934647:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768128 00000100:00100000:2.0:1789518375.934700:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522767872 00000100:00100000:2.0:1789518375.934703:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522767872 00000100:00100000:2.0:1789518375.934725:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518375.934733:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522768128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.934806:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522768128:12345-0@lo:400:kworker.0 Request processed in 74us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518375.934813:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518375.934829:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789518375.934843:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522767872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518375.934876:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876445522767872:12345-0@lo:400:kworker.0 Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518375.934882:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789518375.934915:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303db7800 x1876445522768128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518375.934927:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522768128:0@lo:400:kworker.0 00000100:00080000:1.0:1789518375.938299:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518375.938310:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789518375.938852:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7303db7b80 x1876445522767872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518375.938869:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1876445522767872:0@lo:400:kworker.0 00000001:00100000:3.0:1789518375.939993:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23 00000001:00080000:3.0:1789518375.940018:0:19410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1789518376.118728:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518377.141821:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518377.609440:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518377.609633:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708160 00000100:00100000:2.0:1789518377.609644:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708160 00000100:00100000:2.0:1789518377.609721:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:2.0:1789518377.609732:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:14963:x1876445501708160:12345-192.168.202.43@tcp:41:lfs.0 00000004:00000024:2.0:1789518377.609780:0:19376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789518377.609876:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:14963:x1876445501708160:12345-192.168.202.43@tcp:41:lfs.0 Request processed in 146us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518377.609884:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00080000:1.0:1789518377.612926:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518377.615860:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518377.616083:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708288 00000100:00100000:0.0:1789518377.616106:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708288 00000100:00100000:0.0:1789518377.616413:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:0.0:1789518377.616424:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14963:x1876445501708288:12345-192.168.202.43@tcp:41:lfs.0 00000004:00000024:0.0:1789518377.616506:0:17090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789518377.616591:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14963:x1876445501708288:12345-192.168.202.43@tcp:41:lfs.0 Request processed in 170us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518377.616598:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00080000:1.0:1789518377.617030:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518377.629062:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518377.629506:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708416 00000100:00100000:1.0:1789518377.629517:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708416 00000100:00100000:1.0:1789518377.629604:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:1.0:1789518377.629615:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14963:x1876445501708416:12345-192.168.202.43@tcp:13:lfs.0 00002000:00000024:1.0:1789518377.629646:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789518377.629766:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:14963:x1876445501708416:12345-192.168.202.43@tcp:13:lfs.0 Request processed in 152us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518377.629773:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00080000:2.0:1789518377.629893:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518377.637148:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518377.637598:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708544 00000100:00100000:1.0:1789518377.637609:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708544 00000100:00100000:1.0:1789518377.637691:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789518377.637701:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:14963:x1876445501708544:12345-192.168.202.43@tcp:13:lfs.0 00002000:00000024:1.0:1789518377.637734:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789518377.637824:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:14963:x1876445501708544:12345-192.168.202.43@tcp:13:lfs.0 Request processed in 124us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518377.637831:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00080000:2.0:1789518377.639327:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518377.850078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518377.850324:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708672 00000100:00100000:3.0:1789518377.850334:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708672 00000100:00100000:3.0:1789518377.850393:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:3.0:1789518377.850403:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+10:14993:x1876445501708672:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518377.850420:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518377.850437:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030000/0x8d0fd6794231585b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856650b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518377.850491:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030000/0x8d0fd6794231585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856650b expref: 11 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518377.850502:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030000/0x8d0fd6794231585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856650b expref: 11 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518377.850510:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030000, rc 0) 00000100:00100000:3.0:1789518377.850573:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:14993:x1876445501708672:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 171us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518377.850593:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:0.0:1789518377.859361:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518377.859867:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708800 00000100:00100000:3.0:1789518377.859879:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708800 00000100:00100000:3.0:1789518377.859938:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:3.0:1789518377.859949:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:14993:x1876445501708800:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789518377.860102:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:14993:x1876445501708800:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 154us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518377.860110:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:1.0:1789518377.870167:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518377.870360:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501708928 00000100:00100000:2.0:1789518377.870371:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501708928 00000100:00100000:2.0:1789518377.870424:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 135 00000100:00100000:2.0:1789518377.870433:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:14993:x1876445501708928:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789518377.870594:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:14993:x1876445501708928:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 161us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518377.870610:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 135 00000100:00100000:2.0:1789518377.892114:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518377.893710:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709056 00000100:00100000:0.0:1789518377.893723:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709056 00000100:00100000:0.0:1789518377.893794:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00100000:0.0:1789518377.893804:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:15000:x1876445501709056:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518377.893977:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:15000:x1876445501709056:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 174us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518377.893985:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00100000:0.0:1789518377.951093:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518377.951216:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709184 00000100:00100000:3.0:1789518377.951226:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709184 00000100:00100000:3.0:1789518377.951289:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 137 00000100:00100000:3.0:1789518377.951299:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:15000:x1876445501709184:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518377.951494:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:15000:x1876445501709184:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 196us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518377.951501:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 137 00000100:00100000:1.0:1789518377.969010:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518377.969563:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709312 00000100:00100000:2.0:1789518377.969574:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709312 00000100:00100000:2.0:1789518377.969635:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 138 00000100:00100000:2.0:1789518377.969645:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:15000:x1876445501709312:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518377.970094:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:15000:x1876445501709312:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 449us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518377.970102:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 138 00000100:00100000:2.0:1789518377.985069:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518377.985575:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709440 00000100:00100000:0.0:1789518377.985586:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709440 00000100:00100000:0.0:1789518377.985643:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 139 00000100:00100000:0.0:1789518377.985653:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:14993:x1876445501709440:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518377.985669:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518377.985686:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9de00/0x8d0fd67942315862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856653c expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518377.985715:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9de00/0x8d0fd67942315862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856653c expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518377.985740:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9de00/0x8d0fd67942315862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856653c expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518377.985750:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9de00, rc 0) 00000100:00100000:0.0:1789518377.985811:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14993:x1876445501709440:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 160us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518377.985819:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 139 00000100:00100000:0.0:1789518378.005872:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.007368:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709568 00000100:00100000:3.0:1789518378.007382:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709568 00000100:00100000:3.0:1789518378.007496:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:3.0:1789518378.007507:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14993:x1876445501709568:12345-192.168.202.43@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789518378.007533:0:17083:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789518378.007557:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789518378.007560:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789518378.007562:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789518378.007565:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789518378.007567:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789518378.012841:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14993:x1876445501709568:12345-192.168.202.43@tcp:256:mount.lustre.0 Request processed in 5319us (6961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.012855:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:2.0:1789518378.020174:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.020703:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709696 00000100:00100000:3.0:1789518378.020714:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709696 00000100:00100000:3.0:1789518378.020778:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:3.0:1789518378.020787:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14993:x1876445501709696:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518378.020803:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518378.020830:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566543 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518378.020858:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 13 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518378.020870:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 13 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518378.020878:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030e00, rc 0) 00000100:00100000:3.0:1789518378.020947:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14993:x1876445501709696:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 161us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.020954:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:0.0:1789518378.024858:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.025063:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709824 00000100:00100000:3.0:1789518378.025073:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709824 00000100:00100000:3.0:1789518378.025136:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:3.0:1789518378.025146:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14993:x1876445501709824:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789518378.025337:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14993:x1876445501709824:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 192us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.025363:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:2.0:1789518378.028707:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518378.028806:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501709952 00000100:00100000:1.0:1789518378.028827:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501709952 00000100:00100000:1.0:1789518378.028880:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 143 00000100:00100000:1.0:1789518378.028889:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14993:x1876445501709952:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789518378.029032:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14993:x1876445501709952:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 143us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518378.029040:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 143 00000100:00100000:0.0:1789518378.032058:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518378.032150:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710080 00000100:00100000:2.0:1789518378.032169:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710080 00000100:00100000:2.0:1789518378.032233:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 144 00000100:00100000:2.0:1789518378.032253:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:15007:x1876445501710080:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518378.032395:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:15007:x1876445501710080:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518378.032403:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 144 00000100:00100000:0.0:1789518378.036745:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.036846:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710208 00000100:00100000:3.0:1789518378.036857:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710208 00000100:00100000:3.0:1789518378.036912:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 145 00000100:00100000:3.0:1789518378.036922:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:15007:x1876445501710208:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518378.037063:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:15007:x1876445501710208:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.037072:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 145 00000100:00100000:3.0:1789518378.062441:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.062598:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.062635:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518378.062700:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501711360 00000100:00100000:1.0:1789518378.062712:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501711360 00000100:00100000:1.0:1789518378.062774:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789518378.062785:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501711360:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518378.062869:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501711360:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518378.062876:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:2.0:1789518378.067373:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501711104 00000100:00100000:2.0:1789518378.067518:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501711104 00000100:00100000:1.0:1789518378.067661:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518378.067698:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.067772:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501711232 00000100:00100000:3.0:1789518378.067778:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501711232 00000100:00100000:3.0:1789518378.067813:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:3.0:1789518378.067833:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2388:x1876445501711232:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518378.067910:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2388:x1876445501711232:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.067917:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:0.0:1789518378.068446:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710976 00000100:00100000:0.0:1789518378.068453:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710976 00000100:00100000:0.0:1789518378.068495:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710336 00000100:00100000:0.0:1789518378.068499:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710336 00000100:00100000:0.0:1789518378.068512:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789518378.068520:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2388:x1876445501711104:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518378.068554:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2388:x1876445501711104:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 35us (6123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.068561:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789518378.068575:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:0.0:1789518378.068582:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:2388:x1876445501710976:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518378.068617:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:2388:x1876445501710976:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 36us (5981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.068624:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:0.0:1789518378.068652:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789518378.068657:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1876445501710336:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518378.068680:0:17092:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d7d9db62-953a-469d-a3cd-bfca7d59ab89@192.168.202.43@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1789518378.068716:0:17092:0:(genops.c:1384:class_connect()) connect: client d7d9db62-953a-469d-a3cd-bfca7d59ab89, cookie 0x8d0fd67942315870 00000004:00100000:0.0:1789518378.068743:0:17092:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518378.068837:0:17092:0:(import.c:65:import_set_state_nolock()) ffff8e73028d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518378.068877:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2386:x1876445501710336:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 219us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.068884:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789518378.068934:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518378.069322:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710592 00000100:00100000:0.0:1789518378.069328:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710592 00000100:00100000:0.0:1789518378.069345:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:0.0:1789518378.069349:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1876445501710592:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518378.069364:0:17092:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from d7d9db62-953a-469d-a3cd-bfca7d59ab89@192.168.202.43@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1789518378.069402:0:17092:0:(genops.c:1384:class_connect()) connect: client d7d9db62-953a-469d-a3cd-bfca7d59ab89, cookie 0x8d0fd67942315877 00000004:00100000:0.0:1789518378.069416:0:17092:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518378.069493:0:17092:0:(import.c:65:import_set_state_nolock()) ffff8e7441110800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518378.069521:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2386:x1876445501710592:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 170us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.069528:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:1.0:1789518378.077189:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518378.077230:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518378.077279:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518378.077376:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710464 00000100:00100000:0.0:1789518378.077386:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710464 00000100:00100000:0.0:1789518378.077456:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710720 00000100:00100000:0.0:1789518378.077459:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710720 00000100:00100000:0.0:1789518378.077512:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501710848 00000100:00100000:0.0:1789518378.077520:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501710848 00000100:00100000:0.0:1789518378.077535:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789518378.077544:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+7:0:x1876445501710464:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518378.077575:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789518378.077650:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+7:0:x1876445501710464:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 107us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.077656:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789518378.077673:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:0.0:1789518378.077680:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:0:x1876445501710720:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518378.077691:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789518378.077717:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:0:x1876445501710720:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.077722:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:0.0:1789518378.077735:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789518378.077741:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501710848:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518378.077760:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789518378.077781:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501710848:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 41us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.077786:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00080000:1.0:1789518378.078263:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789518378.078268:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518378.082285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518378.082392:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501711488 00000100:00100000:0.0:1789518378.082402:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501711488 00000100:00100000:0.0:1789518378.082498:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:0.0:1789518378.082509:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501711488:12345-192.168.202.43@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789518378.082581:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501711488:12345-192.168.202.43@tcp:40:mount.lustre.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.082612:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789518378.086709:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518378.086827:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501711872 00000100:00100000:2.0:1789518378.086837:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501711872 00000100:00100000:2.0:1789518378.086927:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789518378.087001:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501711872:12345-192.168.202.43@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789518378.087144:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501711872:12345-192.168.202.43@tcp:900:mount.lustre.0 Request processed in 206us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518378.087162:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:3.0:1789518378.087968:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518378.088001:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518378.088208:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501711616 00000100:00100000:0.0:1789518378.088216:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501711616 00000100:00100000:0.0:1789518378.088249:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501711744 00000100:00100000:0.0:1789518378.088252:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501711744 00000100:00100000:0.0:1789518378.088271:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:0.0:1789518378.088278:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876445501711616:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789518378.088308:0:18597:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d7d9db62-953a-469d-a3cd-bfca7d59ab89@192.168.202.43@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1789518378.088337:0:18597:0:(genops.c:1384:class_connect()) connect: client d7d9db62-953a-469d-a3cd-bfca7d59ab89, cookie 0x8d0fd6794231587e 00002000:00100000:0.0:1789518378.088347:0:18597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d7d9db62-953a-469d-a3cd-bfca7d59ab89/ffff8e7441113000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518378.088358:0:18597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789518378.088435:0:18597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518378.088485:0:18597:0:(import.c:65:import_set_state_nolock()) ffff8e7441114000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518378.088528:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2386:x1876445501711616:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 250us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.088535:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:0.0:1789518378.088551:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:0.0:1789518378.088555:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876445501711744:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789518378.088570:0:18597:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d7d9db62-953a-469d-a3cd-bfca7d59ab89@192.168.202.43@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1789518378.088584:0:18597:0:(genops.c:1384:class_connect()) connect: client d7d9db62-953a-469d-a3cd-bfca7d59ab89, cookie 0x8d0fd67942315885 00002000:00100000:0.0:1789518378.088589:0:18597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d7d9db62-953a-469d-a3cd-bfca7d59ab89/ffff8e7441112000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518378.088595:0:18597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789518378.088638:0:18597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789518378.088652:0:18597:0:(import.c:65:import_set_state_nolock()) ffff8e7441116000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518378.088688:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2386:x1876445501711744:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 131us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518378.088695:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:3.0:1789518378.098942:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518378.099113:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712000 00000100:00100000:1.0:1789518378.099123:0:17094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712000 00000100:00100000:1.0:1789518378.099195:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:1.0:1789518378.099206:0:17094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501712000:12345-192.168.202.43@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789518378.099296:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789518378.099387:0:17094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:14993:x1876445501712000:12345-192.168.202.43@tcp:33:mount.lustre.0 Request processed in 182us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518378.099393:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00010000:00010000:3.0:1789518378.166790:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518378.450326:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518378.450432:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712128 00000100:00100000:2.0:1789518378.450443:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712128 00000100:00100000:2.0:1789518378.450534:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:2.0:1789518378.450544:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:15030:x1876445501712128:12345-192.168.202.43@tcp:101:mkdir.0 00010000:00010000:2.0:1789518378.450564:0:19376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518378.450585:0:19376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd6794231588c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566574 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518378.450660:0:19376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518378.450676:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518378.450691:0:19376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518378.450741:0:19376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789518378.450744:0:19376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789518378.450764:0:19376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518378.450789:0:19376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd6794231588c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 8 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518378.450808:0:19376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 7 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518378.450846:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:2.0:1789518378.450849:0:19376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518378.450853:0:19376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033acc00, rc 0) 00000100:00100000:2.0:1789518378.451164:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+7:15030:x1876445501712128:12345-192.168.202.43@tcp:101:mkdir.0 Request processed in 620us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518378.451172:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:1.0:1789518378.486058:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518378.486081:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522768256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518378.486167:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518378.486266:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768256 00000100:00100000:3.0:1789518378.486276:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768256 00000100:00100000:3.0:1789518378.486348:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518378.486358:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522768256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789518378.486399:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789518378.486451:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522768256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.486459:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518378.486524:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522768256:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789518378.486598:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518378.999716:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518378.999757:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522768384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789518378.999829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518379.000008:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768384 00000100:00100000:3.0:1789518379.000018:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768384 00000100:00100000:3.0:1789518379.000073:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789518379.000084:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522768384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518379.000121:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789518379.000140:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518379.000163:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522768512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518379.000207:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522768384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518379.000217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518379.000221:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789518379.000240:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768512 00000100:00100000:3.0:1789518379.000244:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768512 00000100:00100000:3.0:1789518379.000267:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518379.000273:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522768512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518379.000291:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789518379.000308:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522768384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518379.000330:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522768512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518379.000337:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518379.000370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522768512:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789518379.191027:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518379.512665:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522768640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518379.512764:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518379.513007:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768640 00000100:00100000:3.0:1789518379.513017:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768640 00000100:00100000:3.0:1789518379.513098:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518379.513109:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522768640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518379.513158:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789518379.513213:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522768640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518379.513221:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518379.513276:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522768640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518379.513365:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518380.213741:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518381.046539:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522768768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518381.046618:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522768896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518381.046619:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518381.046684:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518381.046774:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768768 00000100:00100000:2.0:1789518381.046784:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768768 00000100:00100000:2.0:1789518381.046833:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522768896 00000100:00100000:2.0:1789518381.046837:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522768896 00000100:00100000:2.0:1789518381.046854:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518381.046863:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522768768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518381.046894:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789518381.046953:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522768768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518381.046963:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518381.046983:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518381.046992:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522768896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518381.047006:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789518381.047010:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522768768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518381.047052:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522768896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518381.047067:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789518381.047074:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518381.047092:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522768896:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789518381.047177:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789518381.048016:0:17070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d7d9db62-953a-469d-a3cd-bfca7d59ab89 00000001:00100000:0.0:1789518381.048025:0:17070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23 00000001:00100000:0.0:1789518381.048340:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7d9db62-953a-469d-a3cd-bfca7d59ab89 00000001:00100000:0.0:1789518381.048349:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23 00000100:00100000:3.0:1789518381.052442:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522769152:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.052500:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522769408:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.052587:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518381.052590:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518381.052681:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522769024:0@lo:400:kworker.0 00000100:00100000:0.0:1789518381.052728:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522769280:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.054572:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522769920:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.054633:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518381.054696:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769408 00000100:00100000:1.0:1789518381.054705:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769408 00000100:00100000:1.0:1789518381.054750:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769920 00000100:00100000:1.0:1789518381.054752:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769920 00000100:00100000:1.0:1789518381.054782:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518381.054791:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522769408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.054856:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522769408:12345-0@lo:400:kworker.0 Request processed in 65us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.054864:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518381.054886:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518381.054891:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522769920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.054911:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522769920:12345-0@lo:400:kworker.0 Request processed in 21us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.054915:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789518381.054934:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518381.054963:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522769408:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.054970:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522769920:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.055008:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769152 00000100:00100000:1.0:1789518381.055011:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769152 00000100:00100000:1.0:1789518381.055030:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518381.055046:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522769152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.055073:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522769152:12345-0@lo:400:kworker.0 Request processed in 28us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.055093:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000001:00100000:1.0:1789518381.058753:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d7d9db62-953a-469d-a3cd-bfca7d59ab89 00000001:00100000:1.0:1789518381.058785:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23 00000100:00100000:3.0:1789518381.063311:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522769152:0@lo:400:kworker.0 00000100:00100000:3.0:1789518381.063330:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522769664:0@lo:400:kworker.0 00000100:00100000:3.0:1789518381.063396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518381.063447:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522770176:0@lo:400:kworker.0 00000100:00100000:3.0:1789518381.063504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518381.063552:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770176 00000100:00100000:3.0:1789518381.063560:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770176 00000100:00100000:3.0:1789518381.063622:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518381.063631:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522770176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518381.063683:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522770176:12345-0@lo:400:kworker.0 Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518381.063690:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789518381.063715:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518381.063734:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522770176:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.063862:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769664 00000100:00100000:1.0:1789518381.063867:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769664 00000100:00100000:1.0:1789518381.063920:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518381.063927:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522769664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.063965:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522769664:12345-0@lo:400:kworker.0 Request processed in 39us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.063970:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789518381.065522:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518381.065579:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522769664:0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.066414:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518381.066500:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522769536:0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.066565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518381.066574:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769024 00000100:00100000:1.0:1789518381.066586:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769024 00000100:00100000:2.0:1789518381.066597:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522770048:0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.066628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518381.066651:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789518381.066663:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:3637:x1876445522769024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.066675:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769536 00000100:00100000:2.0:1789518381.066682:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769536 00000100:00100000:2.0:1789518381.066720:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518381.066727:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522769536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.066770:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:3637:x1876445522769024:12345-0@lo:400:kworker.0 Request processed in 105us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.066780:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518381.066791:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522769536:12345-0@lo:400:kworker.0 Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518381.066800:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518381.066831:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770048 00000100:00100000:2.0:1789518381.066836:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770048 00000100:00100000:2.0:1789518381.066895:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518381.066904:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522770048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.066947:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522770048:12345-0@lo:400:kworker.0 Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518381.066954:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789518381.066997:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522769024:0@lo:400:kworker.0 00000100:00100000:3.0:1789518381.067015:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522769536:0@lo:400:kworker.0 00010000:00080000:3.0:1789518381.067030:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f980700 x1876445522770048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518381.067040:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522770048:0@lo:400:kworker.0 00000100:00080000:1.0:1789518381.067140:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789518381.071501:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518381.071675:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522769792:0@lo:400:kworker.0 00000100:00100000:0.0:1789518381.071743:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518381.071771:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522770304:0@lo:400:kworker.0 00000100:00100000:0.0:1789518381.071805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518381.071957:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769792 00000100:00100000:2.0:1789518381.071968:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769792 00000100:00100000:2.0:1789518381.072033:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770304 00000100:00100000:2.0:1789518381.072037:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770304 00000100:00100000:0.0:1789518381.072077:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789518381.072090:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522769792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518381.072174:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876445522769792:12345-0@lo:400:kworker.0 Request processed in 86us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.072855:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522769280 00000100:00100000:1.0:1789518381.072876:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522769280 00000100:00100000:1.0:1789518381.072929:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518381.072938:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522769280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.072994:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522769280:12345-0@lo:400:kworker.0 Request processed in 58us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.073002:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518381.074020:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522769280:0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.074064:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876445522769792:0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.075348:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789518381.075375:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789518381.075386:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522770304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789518381.075433:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518381.075441:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789518381.075527:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876445522770304:12345-0@lo:400:kworker.0 Request processed in 151us (3720us total) trans 0 rc 0/0 00010000:00080000:0.0:1789518381.075545:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f982a00 x1876445522770304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518381.075546:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789518381.075559:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1876445522770304:0@lo:400:kworker.0 00010000:00010000:3.0:1789518381.238027:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518381.753452:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789518382.062311:0:19967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789518382.262818:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518383.288748:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518383.526866:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518383.526969:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518383.527009:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518383.527064:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712640 00000100:00100000:1.0:1789518383.527074:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712640 00000100:00100000:1.0:1789518383.527161:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:1.0:1789518383.527174:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2390:x1876445501712640:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518383.527244:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2390:x1876445501712640:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518383.527252:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00080000:3.0:1789518383.528520:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518383.545950:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518383.545996:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713152 00000100:00100000:2.0:1789518383.546006:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713152 00000100:00100000:2.0:1789518383.546072:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:2.0:1789518383.546084:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2390:x1876445501713152:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518383.546171:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2390:x1876445501713152:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518383.546178:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:2.0:1789518383.546224:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518383.546351:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518383.548323:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712384 00000100:00100000:0.0:1789518383.548338:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712384 00000100:00100000:0.0:1789518383.554362:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712896 00000100:00100000:0.0:1789518383.554376:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712896 00000100:00100000:0.0:1789518383.554416:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:0.0:1789518383.554426:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2390:x1876445501712384:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518383.554532:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2390:x1876445501712384:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 106us (27674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518383.554540:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:0.0:1789518383.554910:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:0.0:1789518383.554919:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2390:x1876445501712896:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518383.554953:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2390:x1876445501712896:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 36us (27943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518383.554960:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:2.0:1789518383.561242:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518383.561279:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518383.561304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518383.561336:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712256 00000100:00100000:2.0:1789518383.561347:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712256 00000100:00100000:2.0:1789518383.561396:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:2.0:1789518383.561406:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:2390:x1876445501712256:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518383.561487:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:2390:x1876445501712256:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 82us (15262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518383.561509:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:2.0:1789518383.561546:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712768 00000100:00100000:2.0:1789518383.561551:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712768 00000100:00100000:2.0:1789518383.561580:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713280 00000100:00100000:2.0:1789518383.561582:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713280 00000100:00100000:2.0:1789518383.561603:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:2.0:1789518383.561609:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2390:x1876445501712768:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518383.561652:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2390:x1876445501712768:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 43us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518383.561659:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:2.0:1789518383.561672:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:2.0:1789518383.561678:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2390:x1876445501713280:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518383.561706:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2390:x1876445501713280:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 22us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518383.561711:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:2.0:1789518383.562064:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501712512 00000100:00100000:2.0:1789518383.562070:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501712512 00000100:00100000:2.0:1789518383.562112:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713024 00000100:00100000:2.0:1789518383.562116:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713024 00000100:00100000:2.0:1789518383.562138:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:2.0:1789518383.562143:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2390:x1876445501712512:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518383.562173:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2390:x1876445501712512:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (15822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518383.562180:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:2.0:1789518383.562192:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:2.0:1789518383.562208:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2390:x1876445501713024:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789518383.562970:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2390:x1876445501713024:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 760us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518383.563891:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00080000:2.0:1789518383.564600:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518383.564606:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518383.564608:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518383.564611:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518383.618947:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522770432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518383.619030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518383.619134:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770432 00000100:00100000:2.0:1789518383.619141:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770432 00000100:00100000:2.0:1789518383.619311:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518383.619320:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522770432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518383.619348:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518383.619392:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522770432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518383.619398:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518383.629719:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522770432:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789518383.642682:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789518384.011454:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789518384.117795:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522770560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518384.117865:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518384.118022:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770560 00000100:00100000:1.0:1789518384.118030:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770560 00000100:00100000:1.0:1789518384.118085:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789518384.118107:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522770560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789518384.118142:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789518384.118207:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522770560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518384.118214:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789518384.118259:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522770560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789518384.118819:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522770688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518384.118852:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518384.119548:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770688 00000100:00100000:3.0:1789518384.119555:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770688 00000100:00100000:3.0:1789518384.119591:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518384.119600:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522770688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789518384.119626:0:17830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789518384.119671:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522770688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518384.119678:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000001:00100000:3.0:1789518384.120167:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7d9db62-953a-469d-a3cd-bfca7d59ab89 00000100:00100000:1.0:1789518384.120258:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522770688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789518384.311584:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518384.629713:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518384.629752:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522770816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518384.629822:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518384.629977:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770816 00000100:00100000:2.0:1789518384.629986:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770816 00000100:00100000:2.0:1789518384.630056:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518384.630066:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522770816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518384.630099:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518384.630147:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522770816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518384.630154:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789518384.630242:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522770816:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789518384.630330:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518385.351264:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518386.165660:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522770944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518386.165820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518386.166283:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518386.166303:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522771072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518386.166340:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518386.166516:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522770944 00000100:00100000:2.0:1789518386.166528:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522770944 00000100:00100000:0.0:1789518386.166571:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771072 00000100:00100000:0.0:1789518386.166577:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771072 00000100:00100000:2.0:1789518386.166609:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518386.166632:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522770944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789518386.166753:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789518386.166946:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522770944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 327us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.167018:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522770944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789518386.167070:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518386.167112:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518386.167121:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522771072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518386.167134:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789518386.167211:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522771072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518386.167218:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789518386.167254:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518386.168452:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522771584:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.168544:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518386.168592:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522772096:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.168620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518386.168646:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789518386.168653:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522771200:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.168949:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518386.168988:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522771712:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.169018:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518386.169039:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522772224:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.169060:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518386.169106:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771584 00000100:00100000:1.0:1789518386.169115:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771584 00000100:00100000:1.0:1789518386.169171:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522772096 00000100:00100000:1.0:1789518386.169175:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522772096 00000100:00100000:2.0:1789518386.169276:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771200 00000100:00100000:2.0:1789518386.169280:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771200 00000100:00100000:2.0:1789518386.169329:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518386.169340:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:3637:x1876445522771200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518386.169409:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:3637:x1876445522771200:12345-0@lo:400:kworker.0 Request processed in 71us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518386.169418:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789518386.169605:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522772224 00000100:00100000:1.0:1789518386.169608:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522772224 00000100:00100000:1.0:1789518386.169628:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789518386.169635:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522771584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518386.169750:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518386.169755:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518386.169933:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522771072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518386.169965:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522771456:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.170000:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518386.170025:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522771968:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.170049:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518386.170061:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522772480:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.170102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518386.170118:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789518386.170125:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522771328:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.170150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518386.170170:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522771840:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.170256:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522771584:12345-0@lo:400:kworker.0 Request processed in 38us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.170266:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789518386.170290:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771968 00000100:00100000:1.0:1789518386.170294:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771968 00000100:00100000:1.0:1789518386.170312:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522772480 00000100:00100000:1.0:1789518386.170315:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522772480 00000100:00100000:1.0:1789518386.170343:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518386.170350:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522772096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.170457:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522772096:12345-0@lo:400:kworker.0 Request processed in 107us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.170500:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518386.170515:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789518386.170521:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522772224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.170555:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876445522772224:12345-0@lo:400:kworker.0 Request processed in 35us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.170561:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789518386.170572:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789518386.170578:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522771968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.170603:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522771968:12345-0@lo:400:kworker.0 Request processed in 26us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.170608:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789518386.170618:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518386.170624:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522772480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.170651:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522772480:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.170656:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789518386.171044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518386.171120:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771712 00000100:00100000:1.0:1789518386.171126:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771712 00000100:00100000:1.0:1789518386.171161:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771328 00000100:00100000:1.0:1789518386.171164:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771328 00000100:00100000:1.0:1789518386.171178:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518386.171197:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522771712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.171241:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522771712:12345-0@lo:400:kworker.0 Request processed in 56us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.171248:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518386.171273:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518386.171280:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522771328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.171314:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522771328:12345-0@lo:400:kworker.0 Request processed in 35us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.171319:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789518386.171371:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518386.171406:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522771200:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.171419:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522771712:0@lo:400:kworker.0 00010000:00080000:1.0:1789518386.171435:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f981180 x1876445522772224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518386.171447:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1876445522772224:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.171459:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522771584:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.171547:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522772096:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.171768:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522772352:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.171809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518386.171849:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522771968:0@lo:400:kworker.0 00010000:00080000:3.0:1789518386.171865:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f983480 x1876445522772480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518386.171885:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522772480:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.171908:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522771328:0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.171959:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522772352 00000100:00100000:1.0:1789518386.171963:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522772352 00000100:00100000:1.0:1789518386.172004:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789518386.172012:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522772352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518386.172053:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522772352:12345-0@lo:400:kworker.0 Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518386.172060:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789518386.172091:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518386.172479:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771456 00000100:00100000:2.0:1789518386.172485:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771456 00000100:00100000:2.0:1789518386.172530:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522771840 00000100:00100000:2.0:1789518386.172533:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522771840 00000100:00100000:2.0:1789518386.172556:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518386.172564:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522771456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518386.172609:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522771456:12345-0@lo:400:kworker.0 Request processed in 47us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518386.172624:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518386.172648:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518386.172654:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743bbf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522771840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518386.172701:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743bbf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522771840:12345-0@lo:400:kworker.0 Request processed in 48us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518386.172708:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789518386.173324:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518386.173631:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522771840:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.173651:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522772352:0@lo:400:kworker.0 00000100:00100000:3.0:1789518386.173665:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522771456:0@lo:400:kworker.0 00010000:00010000:2.0:1789518386.360869:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518386.442545:0:20114:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7d14f310 20000000:00000080:2.0:1789518386.442566:0:20114:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e7441188000 uarg=0000000000000000 20000000:01000000:2.0:1789518386.442620:0:20114:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518386.442625:0:20114:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518386.442630:0:20114:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789518386.443230:0:20115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789518386.443501:0:20114:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789518386.455891:0:20114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789518386.456122:0:20114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456152:0:20114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315528 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456162:0:20114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315536 expref: 23 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456170:0:20114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd67942315575 expref: 23 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456177:0:20114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423156da expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456188:0:20114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456218:0:20114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456226:0:20114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456289:0:20114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456311:0:20114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 12 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.456331:0:20114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410739f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772608:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518386.456498:0:20114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456507:0:20114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 12 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.456515:0:20114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772736:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518386.456548:0:20114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd679423156da expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456556:0:20114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd679423156da expref: 23 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.456565:0:20114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410739180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772864:0@lo:104: 00000100:00100000:2.0:1789518386.456618:0:20114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518386.456675:0:20114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942315575 expref: 23 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456684:0:20114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942315575 expref: 23 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.456692:0:20114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772992:0@lo:104: 00000100:00100000:2.0:1789518386.456713:0:20114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518386.456732:0:20114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942315536 expref: 23 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456739:0:20114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942315536 expref: 23 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.456748:0:20114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522773120:0@lo:104: 00000100:00100000:2.0:1789518386.456768:0:20114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518386.456784:0:20114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8d0fd67942315528 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.456792:0:20114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8d0fd67942315528 expref: 23 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.456800:0:20114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522773248:0@lo:104: 00000100:00100000:2.0:1789518386.456819:0:20114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518386.456829:0:20114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73031df540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518386.457038:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522772864 00000100:00100000:3.0:1789518386.457048:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522772864 00000100:00100000:3.0:1789518386.457107:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522772992 00000100:00100000:3.0:1789518386.457110:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522772992 00000100:00100000:3.0:1789518386.457122:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522773120 00000100:00100000:3.0:1789518386.457125:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522773120 00000100:00100000:3.0:1789518386.457134:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522773248 00000100:00100000:3.0:1789518386.457136:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522773248 00000100:00100000:3.0:1789518386.457151:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518386.457161:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+6:20114:x1876445522772864:12345-0@lo:104: 00010000:00010000:3.0:1789518386.457177:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457253:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518386.457260:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+6:20114:x1876445522772864:12345-0@lo:104: Request processed in 100us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.457268:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518386.457287:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518386.457293:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+5:20114:x1876445522772992:12345-0@lo:104: 00010000:00010000:3.0:1789518386.457301:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457347:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789518386.457353:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+5:20114:x1876445522772992:12345-0@lo:104: Request processed in 61us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.457360:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518386.457372:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518386.457378:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+4:20114:x1876445522773120:12345-0@lo:104: 00010000:00010000:3.0:1789518386.457385:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457411:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789518386.457416:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+4:20114:x1876445522773120:12345-0@lo:104: Request processed in 39us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.457422:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518386.457432:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518386.457438:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:20114:x1876445522773248:12345-0@lo:104: 00010000:00010000:3.0:1789518386.457446:0:17073:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457505:0:17073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789518386.457510:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6224dd85-753f-4c3f-83da-7a6019473f75+3:20114:x1876445522773248:12345-0@lo:104: Request processed in 73us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.457515:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789518386.457530:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789518386.457533:0:20114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410739180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772864:0@lo:104: 00010000:00010000:3.0:1789518386.457537:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.457541:0:20114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772992:0@lo:104: 00000100:00100000:2.0:1789518386.457548:0:20114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e741073b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522773120:0@lo:104: 00000100:00100000:2.0:1789518386.457554:0:20114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522773248:0@lo:104: 00010000:00010000:3.0:1789518386.457556:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ad000 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518386.457561:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457571:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518386.457579:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518386.457585:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518386.457629:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457636:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518386.457663:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457672:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423156da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd679423156e1 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457689:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789518386.457693:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457699:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c2a00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518386.457702:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457720:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518386.457727:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518386.457733:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518386.457755:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457761:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518386.457768:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457775:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c2a00/0x8d0fd67942315575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231557c expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457786:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518386.457789:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457795:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3c00 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518386.457798:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457804:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518386.457810:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518386.457822:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518386.457835:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457840:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518386.457858:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457865:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e74421c3c00/0x8d0fd67942315536 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231553d expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457876:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518386.457880:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457886:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b7800 already unused, calling callback (ffffffffc11d3c20) 10000000:00010000:3.0:1789518386.457889:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457896:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518386.457903:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518386.457908:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518386.457919:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457925:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518386.457938:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457944:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff8e743f8b7800/0x8d0fd67942315528 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8d0fd6794231552f expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.457959:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518386.457961:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518386.457963:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518386.457971:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518386.457984:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522773376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518386.458021:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518386.458059:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518386.458065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522773504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518386.458099:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518386.458139:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522773376 00000100:00100000:3.0:1789518386.458140:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522773632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518386.458146:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522773376 00000100:00100000:3.0:1789518386.458161:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518386.458172:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423156da expref: 24 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.458180:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518386.458185:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522773760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518386.458188:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522773504 00000100:00100000:2.0:1789518386.458191:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522773504 00010000:00010000:2.0:1789518386.458202:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942315575 expref: 25 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.458203:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518386.458212:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522773632 00000100:00100000:2.0:1789518386.458215:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522773632 00010000:00010000:2.0:1789518386.458225:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942315536 expref: 26 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.458227:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522773760 00000100:00100000:3.0:1789518386.458230:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522773760 00000100:00100000:2.0:1789518386.458237:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789518386.458242:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942315528 expref: 27 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.458243:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+27:3637:x1876445522773376:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518386.458255:0:17076:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789518386.458255:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518386.458261:0:17077:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd679423156da expref: 27 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.458262:0:17076:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789518386.458271:0:17077:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd679423156da expref: 27 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.458278:0:17075:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789518386.458284:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400031000/0x8d0fd679423156e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd679423156da expref: 27 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.458285:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518386.458297:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+26:3637:x1876445522773504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518386.458297:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518386.458305:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518386.458309:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942315575 expref: 26 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.458318:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942315575 expref: 26 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.458327:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+26:3637:x1876445522773376:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (306us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518386.458328:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b7400/0x8d0fd6794231557c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942315575 expref: 26 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518386.458334:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789518386.458337:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518386.458354:0:17077:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789518386.458357:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+24:3637:x1876445522773504:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518386.458360:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518386.458363:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518386.458365:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+24:3639:x1876445522773632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518386.458372:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789518386.458375:0:17075:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789518386.458376:0:17077:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942315536 expref: 23 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.458380:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518386.458384:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+23:3639:x1876445522773760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518386.458385:0:17077:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942315536 expref: 23 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.458391:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518386.458394:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8d0fd67942315528 expref: 23 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518386.458395:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e743f8b7600/0x8d0fd6794231553d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942315536 expref: 23 pid: 17084 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.458403:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8d0fd67942315528 expref: 22 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518386.461533:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522773504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518386.461553:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6224dd85-753f-4c3f-83da-7a6019473f75:3637:1876445522773376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518386.462567:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518386.462670:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6224dd85-753f-4c3f-83da-7a6019473f75+22:3639:x1876445522773632:12345-0@lo:103:ldlm_bl.0 Request processed in 4301us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518386.462686:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518386.464339:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522773632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518386.470577:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f0ca00/0x8d0fd6794231552f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8d0fd67942315528 expref: 21 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.470609:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518386.472548:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6224dd85-753f-4c3f-83da-7a6019473f75+20:3639:x1876445522773760:12345-0@lo:103:ldlm_bl.0 Request processed in 14150us (14331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.472567:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518386.472863:0:20114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410739f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772608:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789518386.472885:0:20114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20114:1876445522772736:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518386.473096:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522773760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518386.473128:0:20114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518386.478417:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518386.478550:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518386.478949:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713408 00000100:00100000:3.0:1789518386.478963:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713408 00010000:00010000:3.0:1789518386.479245:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 13 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.479287:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713536 00000100:00100000:3.0:1789518386.479291:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713536 00010000:00010000:3.0:1789518386.479306:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 14 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518386.479338:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:3.0:1789518386.479349:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404db5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+14:2387:x1876445501713408:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518386.479377:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518386.479383:0:17076:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 14 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479397:0:17076:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 14 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479419:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7400030e00/0x8d0fd67942315869 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566543 expref: 14 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479437:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518386.479524:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404db5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:2387:x1876445501713408:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 175us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.479532:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:3.0:1789518386.479598:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:3.0:1789518386.479606:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:2387:x1876445501713536:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518386.479613:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518386.479618:0:17076:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 12 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479628:0:17076:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 12 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479639:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e7435f9cc00/0x8d0fd6794231582a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785664d3 expref: 12 pid: 17082 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479652:0:17076:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479664:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479697:0:17076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479715:0:17076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479723:0:17076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479730:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479737:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033ade00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:3.0:1789518386.479757:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479767:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479785:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518386.479797:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518386.479819:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:2387:x1876445501713536:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 214us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518386.479826:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00010000:00010000:0.0:1789518386.482492:0:20114:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518386.482515:0:20114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518386.482524:0:20114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e73033ade00/0x8d0fd6794231589a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.386031:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518387.856864:0:17087:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518387.856875:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e740d7b7800 from 13 10000000:01000000:0.0:1789518387.856883:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518387.856954:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd679423158a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518387.856969:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd679423158a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518387.856983:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd679423158a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518387.857021:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522773888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.857127:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518387.857184:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518387.857226:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522773888 00000100:00100000:1.0:1789518387.857248:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522773888 00000100:00100000:1.0:1789518387.857326:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789518387.857337:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+20:17087:x1876445522773888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518387.857354:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518387.857371:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423158a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423158a1 expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.857400:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423158a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423158a1 expref: 21 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.857412:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b6400/0x8d0fd679423158a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423158a1 expref: 21 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.857422:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b6400, rc 0) 00000100:00100000:1.0:1789518387.857497:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522773888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518387.857505:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789518387.857584:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522773888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518387.857601:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd679423158a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158a8 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518387.857611:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd679423158a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423158a8 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518387.857699:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.857726:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518387.857754:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518387.857773:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774016 00000100:00100000:1.0:1789518387.857778:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774016 00000100:00100000:1.0:1789518387.857823:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789518387.857830:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522774016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.857973:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522774016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518387.857982:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789518387.858016:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.858048:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.858101:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518387.858123:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518387.858246:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774144 00000100:00100000:1.0:1789518387.858251:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774144 00000100:00100000:1.0:1789518387.858287:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789518387.858294:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7419693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522774144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.858378:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7419693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522774144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518387.858385:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789518387.858512:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518387.859541:0:20155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789518387.860229:0:17087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789518387.860258:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518387.860270:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd679423158a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158a8 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.860283:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e7435f9d600/0x8d0fd679423158a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158a8 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518387.860296:0:17087:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518387.860299:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e730205f000 from 13 10000000:01000000:1.0:1789518387.860303:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518387.860354:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423158af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.860363:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423158af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.860375:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423158af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518387.860402:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.860515:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518387.860570:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d81240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518387.860598:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774272 00000100:00100000:1.0:1789518387.860606:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774272 00000100:00100000:1.0:1789518387.860668:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789518387.860679:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+21:17087:x1876445522774272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518387.860695:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518387.860711:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7600/0x8d0fd679423158b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423158af expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.861218:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7600/0x8d0fd679423158b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423158af expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.861232:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7600/0x8d0fd679423158b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423158af expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.861242:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7600, rc 0) 00000100:00100000:1.0:1789518387.861297:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:17087:x1876445522774272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 620us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518387.861305:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789518387.861957:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518387.861983:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423158af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158b6 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518387.861995:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423158af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423158b6 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518387.862108:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.862150:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518387.862177:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518387.862569:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774400 00000100:00100000:1.0:1789518387.862577:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774400 00000100:00100000:1.0:1789518387.862635:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789518387.862646:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+22:17087:x1876445522774400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.863170:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+22:17087:x1876445522774400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 524us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518387.863180:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789518387.864163:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.864230:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.864292:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518387.864336:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e743b430840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518387.864744:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774528 00000100:00100000:2.0:1789518387.864754:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774528 00000100:00100000:2.0:1789518387.864828:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789518387.864839:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:17087:x1876445522774528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518387.864975:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:17087:x1876445522774528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518387.864984:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789518387.865044:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303601f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518387.866632:0:20156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789518387.868163:0:17087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789518387.868203:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518387.868217:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423158af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158b6 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518387.868242:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e743f8b6c00/0x8d0fd679423158af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158b6 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518387.868256:0:17087:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518387.868258:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e7303537800 from 13 10000000:01000000:2.0:1789518387.868262:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518387.868311:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ade00/0x8d0fd679423158bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518387.868320:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ade00/0x8d0fd679423158bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518387.868334:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ade00/0x8d0fd679423158bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518387.868368:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518387.868458:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518387.868530:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7411251e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518387.868600:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774656 00000100:00100000:1.0:1789518387.868610:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774656 00000100:00100000:1.0:1789518387.869955:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789518387.869977:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+22:17087:x1876445522774656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518387.870000:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518387.870023:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7400/0x8d0fd679423158c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423158bd expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.870054:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7400/0x8d0fd679423158c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423158bd expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.870078:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7400/0x8d0fd679423158c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423158bd expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.870087:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7400, rc 0) 00000100:00100000:1.0:1789518387.870168:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522774656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518387.870176:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789518387.870444:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518387.870490:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ade00/0x8d0fd679423158bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158c4 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518387.870501:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ade00/0x8d0fd679423158bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423158c4 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518387.870598:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518387.870636:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518387.870692:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7411251e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518387.871084:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774784 00000100:00100000:1.0:1789518387.871092:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774784 00000100:00100000:1.0:1789518387.871142:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789518387.871152:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522774784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.871370:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522774784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518387.871378:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518387.874532:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.874697:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.874808:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518387.874858:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518387.875043:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522774912 00000100:00100000:0.0:1789518387.875051:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522774912 00000100:00100000:0.0:1789518387.875129:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789518387.875140:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522774912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518387.875294:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522774912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518387.875302:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789518387.875394:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522774912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518387.884160:0:20157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789518387.884404:0:17087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789518387.884435:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518387.884452:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ade00/0x8d0fd679423158bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158c4 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518387.884496:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ade00/0x8d0fd679423158bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158c4 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518387.884510:0:17087:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518387.884514:0:17087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e743f99c000 from 13 10000000:01000000:2.0:1789518387.884517:0:17087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518387.884572:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423158cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518387.884581:0:17087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423158cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518387.884594:0:17087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423158cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518387.884626:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522775040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518387.884716:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518387.884771:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7411251e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518387.884843:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522775040 00000100:00100000:0.0:1789518387.884853:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522775040 00000100:00100000:0.0:1789518387.885068:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518387.885082:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+23:17087:x1876445522775040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518387.885101:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518387.885117:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423158d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8d0fd679423158cb expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518387.885164:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423158d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8d0fd679423158cb expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518387.885176:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7435f9c600/0x8d0fd679423158d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8d0fd679423158cb expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518387.885186:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c600, rc 0) 00000100:00100000:0.0:1789518387.885242:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522775040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518387.885249:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789518387.885330:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522775040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518387.885356:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423158cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158d2 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.885365:0:17087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423158cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8d0fd679423158d2 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518387.885438:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522775168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.885491:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518387.886751:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d81000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518387.886826:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522775168 00000100:00100000:2.0:1789518387.886836:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522775168 00000100:00100000:2.0:1789518387.890254:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789518387.890273:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522775168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518387.890525:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522775168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (5032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518387.890545:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789518387.890751:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522775168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.890836:0:17087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522775296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518387.890911:0:17087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518387.890950:0:17087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d81000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518387.890996:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522775296 00000100:00100000:2.0:1789518387.891005:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522775296 00000100:00100000:2.0:1789518387.891027:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789518387.891034:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522775296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518387.891136:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6224dd85-753f-4c3f-83da-7a6019473f75+24:17087:x1876445522775296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518387.891144:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789518387.892133:0:17087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6224dd85-753f-4c3f-83da-7a6019473f75:17087:1876445522775296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518387.894671:0:20160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789518387.894783:0:17087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789518387.894823:0:17087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518387.894837:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423158cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158d2 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518387.894852:0:17087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff8e73033ad000/0x8d0fd679423158cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8d0fd679423158d2 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518387.989511:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518387.989556:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713664 00000100:00100000:3.0:1789518387.989570:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713664 00000100:00100000:3.0:1789518387.989635:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 161 00000100:00100000:3.0:1789518387.989646:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+11:14877:x1876445501713664:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518387.989670:0:17084:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518387.989693:0:17084:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e7400030600/0x8d0fd679423158d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856657b expref: -99 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518387.989728:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e7400030600/0x8d0fd679423158d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856657b expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518387.989742:0:17084:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e7400030600/0x8d0fd679423158d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856657b expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518387.989775:0:17084:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030600, rc 0) 00000100:00100000:3.0:1789518387.989852:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14877:x1876445501713664:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 208us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518387.989860:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 161 00000100:00100000:1.0:1789518387.993027:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518387.993182:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713792 00000100:00100000:2.0:1789518387.993195:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713792 00000100:00100000:2.0:1789518387.993279:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00100000:2.0:1789518387.993293:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14877:x1876445501713792:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518388.001742:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14877:x1876445501713792:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 8431us (8710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518388.001763:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00100000:3.0:1789518388.012617:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518388.012957:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501713920 00000100:00100000:0.0:1789518388.012972:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501713920 00000100:00100000:0.0:1789518388.013099:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:0.0:1789518388.013112:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14877:x1876445501713920:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518388.013314:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14877:x1876445501713920:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 204us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518388.013323:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:3.0:1789518388.022930:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518388.024482:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714048 00000100:00100000:1.0:1789518388.024505:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714048 00000100:00100000:1.0:1789518388.024598:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:1.0:1789518388.024631:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+12:14877:x1876445501714048:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518388.024666:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518388.024693:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e743f8b7800/0x8d0fd679423158e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566582 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518388.024741:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e743f8b7800/0x8d0fd679423158e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566582 expref: 13 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518388.024754:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e743f8b7800/0x8d0fd679423158e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566582 expref: 13 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518388.024765:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e743f8b7800, rc 0) 00000100:00100000:1.0:1789518388.024853:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14877:x1876445501714048:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 227us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518388.024861:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:1.0:1789518388.062052:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518388.063506:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714176 00000100:00100000:3.0:1789518388.063527:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714176 00000100:00100000:3.0:1789518388.063609:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:3.0:1789518388.063622:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14877:x1876445501714176:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518388.064182:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14877:x1876445501714176:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 558us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518388.064194:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:3.0:1789518388.066330:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518388.066525:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714304 00000100:00100000:0.0:1789518388.066538:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714304 00000100:00100000:0.0:1789518388.066612:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 166 00000100:00100000:0.0:1789518388.066625:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74377af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14877:x1876445501714304:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518388.066940:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74377af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:14877:x1876445501714304:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 317us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518388.066957:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 166 00010000:00010000:3.0:1789518388.405846:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518388.639896:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518388.640192:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518388.640228:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518388.640342:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714816 00000100:00100000:3.0:1789518388.640356:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714816 00000100:00100000:3.0:1789518388.640445:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789518388.640458:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501714816:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518388.640582:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501714816:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 126us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518388.640591:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00080000:2.0:1789518388.641112:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518388.641324:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518388.641360:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518388.641426:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501715328 00000100:00100000:3.0:1789518388.641431:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501715328 00000100:00100000:3.0:1789518388.641489:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:3.0:1789518388.641498:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501715328:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518388.641543:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501715328:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518388.641568:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789518388.642673:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714560 00000100:00100000:0.0:1789518388.642686:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714560 00000100:00100000:0.0:1789518388.642764:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501715072 00000100:00100000:0.0:1789518388.642768:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501715072 00000100:00100000:0.0:1789518388.642800:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789518388.642809:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501714560:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518388.643216:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501714560:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 407us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518388.643227:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789518388.643250:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:0.0:1789518388.643259:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501715072:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518388.643285:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501715072:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (3057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518388.643291:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:1.0:1789518388.644520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518388.644556:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714688 00000100:00100000:1.0:1789518388.644564:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714688 00000100:00100000:1.0:1789518388.644615:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789518388.644624:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501714688:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789518388.645942:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518388.645992:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518388.646030:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501715200 00000100:00100000:3.0:1789518388.646039:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501715200 00000100:00100000:1.0:1789518388.646251:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501714688:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 1625us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518388.646271:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789518388.646302:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:1.0:1789518388.646313:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501715200:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518388.646351:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501715200:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 41us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518388.646358:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:1.0:1789518388.647488:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714432 00000100:00100000:1.0:1789518388.647500:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714432 00000100:00100000:1.0:1789518388.647543:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501714944 00000100:00100000:1.0:1789518388.647546:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501714944 00000100:00100000:1.0:1789518388.647567:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:1.0:1789518388.647574:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2388:x1876445501714432:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518388.647629:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2388:x1876445501714432:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 56us (6269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518388.647636:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:1.0:1789518388.647663:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:1.0:1789518388.647669:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2388:x1876445501714944:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518388.647690:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2388:x1876445501714944:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518388.647696:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00080000:2.0:1789518388.649071:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518388.649080:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518388.649084:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789518388.649087:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518388.727243:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518388.727276:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522775424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518388.727379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518388.727925:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522775424 00000100:00100000:2.0:1789518388.727937:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522775424 00000100:00100000:2.0:1789518388.728071:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518388.728083:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522775424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789518388.728190:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518388.728317:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522775424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 236us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518388.728343:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789518388.728453:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518388.728935:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522775424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789518389.242839:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522775552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789518389.242941:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518389.243168:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518389.243187:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522775680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518389.244536:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522775552 00000100:00100000:0.0:1789518389.244551:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522775552 00000100:00100000:0.0:1789518389.244630:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518389.244641:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522775552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789518389.244686:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789518389.248154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518389.250097:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522775552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5441us (7139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518389.250119:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518389.250174:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522775680 00000100:00100000:0.0:1789518389.250208:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522775680 00000100:00100000:0.0:1789518389.250257:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789518389.250267:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522775680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789518389.250337:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789518389.250393:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522775680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518389.250399:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518389.252411:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522775680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518389.253283:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522775552:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789518389.429931:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518389.749988:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7410739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522775808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518389.750117:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518389.750250:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522775808 00000100:00100000:2.0:1789518389.750273:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522775808 00000100:00100000:2.0:1789518389.750371:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518389.750383:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522775808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518389.750413:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789518389.750500:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522775808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518389.750509:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518389.750571:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7410739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522775808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518389.751291:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518390.456403:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518390.673043:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518390.673253:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501715456 00000100:00100000:1.0:1789518390.673268:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501715456 00000100:00100000:1.0:1789518390.673387:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:1.0:1789518390.673400:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:15546:x1876445501715456:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518390.673439:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518390.673523:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423158e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566589 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673608:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673626:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673642:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673658:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673666:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673673:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673784:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd679423158fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673793:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd679423158fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673822:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd679423158fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518390.673875:0:17092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789518390.673880:0:17092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789518390.673932:0:17092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd679423158fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673944:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673951:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673959:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673966:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518390.673971:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673980:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.673994:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:1.0:1789518390.673997:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518390.674003:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674010:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6800/0x8d0fd679423158ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674052:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674059:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674066:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674071:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e743f8b6000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518390.674074:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674081:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674090:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e7418bdf200) 00010000:00010000:1.0:1789518390.674092:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518390.674095:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674101:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b6000/0x8d0fd679423158f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674147:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e743f8b7a00/0x8d0fd679423158e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566589 expref: 8 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674164:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ca00/0x8d0fd679423158fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566589 expref: 7 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.674183:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e7441627700) 00010000:00010000:1.0:1789518390.674186:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518390.674189:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0ca00, rc 0) 00000100:00100000:1.0:1789518390.674290:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:15546:x1876445501715456:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 894us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518390.674299:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00080000:3.0:1789518390.676045:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518390.686796:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518390.687061:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501715584 00000100:00100000:3.0:1789518390.687077:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501715584 00000100:00100000:3.0:1789518390.687311:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:3.0:1789518390.687324:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:15546:x1876445501715584:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789518390.687507:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:15546:x1876445501715584:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 Request processed in 143us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518390.687518:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:2.0:1789518390.697391:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518390.697914:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501715840 00000100:00100000:0.0:1789518390.697936:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501715840 00000100:00100000:0.0:1789518390.698090:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789518390.698104:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:15546:x1876445501715840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518390.698139:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518390.698169:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315903 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566590 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698294:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698313:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698326:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698562:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698591:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698617:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698894:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942315918 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698904:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942315918 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.698912:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942315918 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518390.698923:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789518390.699088:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699097:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699104:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699110:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518390.699115:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699123:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699135:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e7441627700) 00010000:00010000:0.0:1789518390.699138:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518390.699148:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699155:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd6794231590a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699172:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699178:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699185:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699190:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518390.699193:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699199:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699206:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e7303358d00) 00010000:00010000:0.0:1789518390.699208:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518390.699211:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.699217:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315911 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.700168:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315903 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566590 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.700203:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9dc00/0x8d0fd67942315918 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566590 expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.700211:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7303358700) 00010000:00010000:0.0:1789518390.700213:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518390.700216:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9dc00, rc 0) 00000100:00100000:0.0:1789518390.700289:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15546:x1876445501715840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 2187us (2913us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789518390.700300:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789518390.722240:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518390.723134:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501715968 00000100:00100000:2.0:1789518390.723151:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501715968 00000100:00100000:2.0:1789518390.723242:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:2.0:1789518390.723254:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15546:x1876445501715968:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789518390.724077:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15546:x1876445501715968:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 820us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518390.724090:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:1.0:1789518390.749170:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518390.750812:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501716096 00000100:00100000:2.0:1789518390.750835:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501716096 00000100:00100000:2.0:1789518390.750974:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:2.0:1789518390.750993:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:15546:x1876445501716096:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789518390.751558:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789518390.753822:0:17091:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2750us 00000100:00100000:1.0:1789518390.779387:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518390.779531:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501716224 00000100:00100000:2.0:1789518390.779546:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501716224 00000100:00100000:2.0:1789518390.779622:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:2.0:1789518390.779647:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15552:x1876445501716224:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518390.780845:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518390.780947:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566597 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.781622:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.781644:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.781658:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.784406:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.784437:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.784500:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790139:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790150:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790159:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790166:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518390.790171:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790180:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790201:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:1.0:1789518390.790204:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518390.790208:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790214:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd6794231592d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790232:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790239:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790259:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790265:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0dc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518390.790268:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790274:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790282:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e7441627900) 00010000:00010000:1.0:1789518390.790284:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518390.790288:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790294:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315934 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790356:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315926 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566597 expref: 10 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790367:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:1.0:1789518390.790369:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518390.790373:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566597 expref: 10 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.790385:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c400, rc 0) 00000100:00100000:1.0:1789518390.790506:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15552:x1876445501716224:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 10861us (11132us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518390.790526:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:1.0:1789518390.796074:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518390.796225:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501716352 00000100:00100000:2.0:1789518390.796242:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501716352 00000100:00100000:2.0:1789518390.796311:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:2.0:1789518390.796325:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15552:x1876445501716352:12345-192.168.202.43@tcp:700:lfs.0 00000100:00100000:2.0:1789518390.796446:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15552:x1876445501716352:12345-192.168.202.43@tcp:700:lfs.0 Request processed in 124us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518390.796454:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:3.0:1789518390.798593:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518390.798812:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501716608 00000100:00100000:1.0:1789518390.798825:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501716608 00000100:00100000:1.0:1789518390.798909:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:1.0:1789518390.798922:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:15552:x1876445501716608:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:1.0:1789518390.799007:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518390.799058:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd67942315854 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566504 expref: 9 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.799085:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:1.0:1789518390.799092:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518390.799182:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.799201:0:17090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 5 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.799212:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.799256:0:17090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 5 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.799273:0:17090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 5 pid: 19376 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518390.799291:0:17090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17090:1876445522775936:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518390.799432:0:17090:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518390.804000:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518390.804981:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501716736 00000100:00100000:3.0:1789518390.804997:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501716736 00010000:00010000:3.0:1789518390.805079:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 6 pid: 19376 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518390.805125:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789518390.805137:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2387:x1876445501716736:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518390.805157:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518390.805164:0:17076:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 6 pid: 19376 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518390.805180:0:17076:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 6 pid: 19376 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518390.805212:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:3.0:1789518390.805219:0:17076:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518390.805245:0:17076:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518390.805255:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518390.805280:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518390.805351:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2387:x1876445501716736:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 216us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518390.805361:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00080000:3.0:1789518390.805405:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789518390.805772:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315893 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566574 expref: 5 pid: 19376 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518390.805794:0:17090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d62300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17090:1876445522775936:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789518390.805822:0:17090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.805833:0:17090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.805839:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.806228:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.806242:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.806258:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518390.825665:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:15546:x1876445501716096:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 74652us (76481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518390.825685:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00010000:00010000:0.0:1789518390.834648:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834673:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834687:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518390.834737:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b52215f reply state 000000005d3504ea transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834750:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834757:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:0.0:1789518390.834760:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518390.834765:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789518390.834771:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789518390.834781:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834787:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834795:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834801:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518390.834823:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834832:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834954:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e730335cd00) 00010000:00010000:0.0:1789518390.834958:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518390.834963:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.834970:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d400/0x8d0fd6794231593b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518390.834996:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b52215f reply state 000000005d3504ea transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.835006:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518390.835011:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e7303358d00) 00010000:00010000:0.0:1789518390.835013:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518390.835015:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789518390.835226:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+10:15552:x1876445501716608:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 36301us (36640us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789518390.835236:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:2.0:1789518390.955200:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518390.955331:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501716864 00000100:00100000:1.0:1789518390.955344:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501716864 00000100:00100000:1.0:1789518390.955432:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:1.0:1789518390.955446:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+10:15560:x1876445501716864:12345-192.168.202.43@tcp:101:lctl.0 00010000:00010000:1.0:1789518390.955522:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518390.955551:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856659e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.955646:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315957 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.955674:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.955688:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518390.955743:0:17092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789518390.955747:0:17092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789518390.955805:0:17092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.955835:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856659e expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.955975:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0dc00/0x8d0fd67942315957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856659e expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518390.956009:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:1.0:1789518390.956012:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518390.956016:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0dc00, rc 0) 00000100:00100000:1.0:1789518390.956102:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+11:15560:x1876445501716864:12345-192.168.202.43@tcp:101:lctl.0 Request processed in 659us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518390.956110:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000040:00080000:1.0:1789518390.966729:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789518391.008558:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.008977:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501716992 00000100:00100000:1.0:1789518391.008991:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501716992 00000100:00100000:1.0:1789518391.009079:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:1.0:1789518391.009399:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:15561:x1876445501716992:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518391.009429:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518391.009457:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd6794231595e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665a5 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.009577:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942315965 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.009597:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942315965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.009615:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942315965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518391.009677:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789518391.009683:0:17091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789518391.010282:0:17091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942315965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.010500:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd6794231595e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665a5 expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.010530:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0d000/0x8d0fd67942315965 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665a5 expref: 6 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.010541:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:1.0:1789518391.010544:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518391.010548:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0d000, rc 0) 00000100:00100000:1.0:1789518391.010652:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:15561:x1876445501716992:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1561us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.010661:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:2.0:1789518391.022622:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518391.024376:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501717120 00000100:00100000:3.0:1789518391.024401:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501717120 00000100:00100000:3.0:1789518391.024540:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:3.0:1789518391.024553:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:15561:x1876445501717120:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518391.024579:0:19376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518391.024610:0:19376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd6794231596c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665ac expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024700:0:19376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024718:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024731:0:19376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024744:0:19376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024751:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024758:0:19376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024907:0:19376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942315981 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024916:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942315981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.024924:0:19376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942315981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518391.024979:0:19376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789518391.024983:0:19376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518391.025011:0:19376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942315981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025026:0:19376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025045:0:19376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025052:0:19376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025059:0:19376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518391.025064:0:19376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025073:0:19376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025088:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:3.0:1789518391.025098:0:19376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518391.025106:0:19376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025113:0:19376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025132:0:19376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025139:0:19376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025146:0:19376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025152:0:19376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030800 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518391.025155:0:19376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025161:0:19376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025169:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e7303358d00) 00010000:00010000:3.0:1789518391.025171:0:19376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518391.025174:0:19376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025179:0:19376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd6794231597a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025210:0:19376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd6794231596c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665ac expref: 8 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025248:0:19376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942315981 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665ac expref: 7 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.025256:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:3.0:1789518391.025258:0:19376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518391.025261:0:19376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031600, rc 0) 00000100:00100000:3.0:1789518391.025371:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+7:15561:x1876445501717120:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 820us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.025380:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:2.0:1789518391.034570:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.034741:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501717248 00000100:00100000:1.0:1789518391.034757:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501717248 00000100:00100000:1.0:1789518391.034858:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:1.0:1789518391.034872:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:15561:x1876445501717248:12345-192.168.202.43@tcp:900:lfs.0 00000100:00100000:1.0:1789518391.034986:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e741073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:15561:x1876445501717248:12345-192.168.202.43@tcp:900:lfs.0 Request processed in 117us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.034994:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00080000:3.0:1789518391.035725:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789518391.046624:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.051696:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501717504 00000100:00100000:1.0:1789518391.051723:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501717504 00000100:00100000:1.0:1789518391.051829:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:1.0:1789518391.051843:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+7:15561:x1876445501717504:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518391.051872:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518391.051898:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665b3 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518391.052070:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789518391.052225:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315988 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665b3 expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.052242:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:1.0:1789518391.052246:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518391.052251:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665b3 expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.052270:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c400, rc 0) 00000100:00100000:1.0:1789518391.052373:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+8:15561:x1876445501717504:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 532us (5765us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789518391.052441:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:0.0:1789518391.063973:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518391.064084:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501717760 00000100:00100000:3.0:1789518391.064101:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501717760 00000100:00100000:3.0:1789518391.064182:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:3.0:1789518391.064195:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+8:15561:x1876445501717760:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:3.0:1789518391.064279:0:19376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518391.064314:0:19376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd67942315981 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665ac expref: 8 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.064341:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:3.0:1789518391.064347:0:19376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518391.064374:0:19376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.064813:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.064828:0:19376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518391.065121:0:19376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003152f007 reply state 00000000e76e9b10 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.065137:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.065144:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:3.0:1789518391.065147:0:19376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789518391.065151:0:19376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789518391.065173:0:19376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789518391.065277:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+9:15561:x1876445501717760:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 1084us (1315us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789518391.065287:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:0.0:1789518391.068164:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518391.068309:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501718016 00000100:00100000:3.0:1789518391.068323:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501718016 00000100:00100000:3.0:1789518391.068406:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:3.0:1789518391.068419:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+9:15561:x1876445501718016:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789518391.069200:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+10:15561:x1876445501718016:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 778us (1055us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789518391.069230:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:0.0:1789518391.079321:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.080328:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501718272 00000100:00100000:1.0:1789518391.080347:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501718272 00000100:00100000:1.0:1789518391.080443:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:1.0:1789518391.080455:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+10:15561:x1876445501718272:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518391.080536:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518391.080564:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd6794231599d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665ba expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.080670:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.080688:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.080739:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.080753:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.080761:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.080768:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518391.080912:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789518391.081000:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081009:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081017:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081024:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518391.081030:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081049:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081065:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:1.0:1789518391.081068:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518391.081079:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081086:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081104:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081109:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081115:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081121:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0ce00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518391.081125:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081131:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081139:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e7303358d00) 00010000:00010000:1.0:1789518391.081141:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518391.081143:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081149:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081190:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd6794231599d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665ba expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081213:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:1.0:1789518391.081216:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518391.081220:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd6794231599d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665ba expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.081231:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c400, rc 0) 00000100:00100000:1.0:1789518391.081311:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+11:15561:x1876445501718272:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 858us (2004us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789518391.081320:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:0.0:1789518391.090094:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.090235:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501718400 00000100:00100000:1.0:1789518391.090251:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501718400 00000100:00100000:1.0:1789518391.090329:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:1.0:1789518391.090340:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+11:15561:x1876445501718400:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789518391.090372:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518391.090402:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd679423159b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665c1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.090576:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.090596:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.090612:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518391.090655:0:17092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789518391.090667:0:17092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789518391.090695:0:17092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.090738:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd679423159b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 13 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.090759:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.090767:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:1.0:1789518391.090770:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518391.090775:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0ce00, rc 0) 00000100:00100000:1.0:1789518391.090841:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+12:15561:x1876445501718400:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 502us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.090848:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:0.0:1789518391.100459:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.100991:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501718528 00000100:00100000:1.0:1789518391.101007:0:17094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501718528 00000100:00100000:1.0:1789518391.101095:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789518391.101108:0:17094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+12:15561:x1876445501718528:12345-192.168.202.43@tcp:37:lfs.0 00000100:00100000:2.0:1789518391.115524:0:17094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d7d9db62-953a-469d-a3cd-bfca7d59ab89+12:15561:x1876445501718528:12345-192.168.202.43@tcp:37:lfs.0 Request processed in 14400us (15065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518391.115544:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:2.0:1789518391.137553:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518391.138649:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501718784 00000100:00100000:0.0:1789518391.138667:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501718784 00000100:00100000:0.0:1789518391.138749:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:0.0:1789518391.138761:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7406ded050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+12:15561:x1876445501718784:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518391.139066:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7406ded050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7d9db62-953a-469d-a3cd-bfca7d59ab89+13:15561:x1876445501718784:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 306us (1527us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789518391.139074:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000040:00080000:0.0:1789518391.159768:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789518391.213552:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.213636:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501718912 00000100:00100000:1.0:1789518391.213657:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501718912 00000100:00100000:0.0:1789518391.214041:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:0.0:1789518391.214057:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+11:15567:x1876445501718912:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518391.214088:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518391.214116:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd679423159c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665c8 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214200:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214220:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214247:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214264:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214272:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214298:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214395:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd679423159dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214405:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd679423159dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.214413:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd679423159dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518391.214455:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789518391.214460:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518391.216108:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd679423159dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216135:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216144:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216153:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216158:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518391.216163:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216173:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216210:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:0.0:1789518391.216214:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518391.216220:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216228:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd679423159ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216251:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216259:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216265:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216271:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ce00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:0.0:1789518391.216274:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216280:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216287:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e7303358d00) 00010000:00010000:0.0:1789518391.216290:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518391.216293:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216299:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd679423159d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216359:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd679423159c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c8 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216376:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c800/0x8d0fd679423159dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c8 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.216383:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:0.0:1789518391.216385:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518391.216388:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c800, rc 0) 00000100:00100000:0.0:1789518391.217953:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+12:15567:x1876445501718912:12345-192.168.202.43@tcp:101:bash.0 Request processed in 3887us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518391.217969:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:0.0:1789518391.229150:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.233051:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501719040 00000100:00100000:1.0:1789518391.233078:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501719040 00000100:00100000:1.0:1789518391.233149:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:1.0:1789518391.233161:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:15567:x1876445501719040:12345-192.168.202.43@tcp:900:bash.0 00000100:00100000:1.0:1789518391.233277:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:15567:x1876445501719040:12345-192.168.202.43@tcp:900:bash.0 Request processed in 118us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.233307:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:2.0:1789518391.239188:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.239328:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501719296 00000100:00100000:1.0:1789518391.239342:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501719296 00000100:00100000:1.0:1789518391.239482:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:1.0:1789518391.239494:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+12:15567:x1876445501719296:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789518391.239529:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518391.239556:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd679423159e3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665cf expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.239725:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.239743:0:17092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.240206:0:17092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.240266:0:17092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.240283:0:17092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 12 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518391.240300:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17092:1876445522776064:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518391.240412:0:17092:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d81540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518391.246966:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17092:1876445522776064:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789518391.247026:0:17092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518391.250247:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518391.250418:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501719424 00000100:00100000:0.0:1789518391.250432:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501719424 00010000:00010000:0.0:1789518391.250547:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 13 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518391.250598:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789518391.250611:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+13:2388:x1876445501719424:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518391.250634:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518391.250642:0:17077:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 13 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.250659:0:17077:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 13 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.250716:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0ce00/0x8d0fd679423159c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665c1 expref: 13 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.250741:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:0.0:1789518391.250747:0:17077:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.251037:0:17077:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.251047:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518391.251167:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518391.251254:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d9db62-953a-469d-a3cd-bfca7d59ab89+12:2388:x1876445501719424:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 644us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.251263:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00010000:00010000:3.0:1789518391.252293:0:17092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.252308:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.252341:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.252354:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.252385:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254270:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254296:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254309:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518391.254322:0:17092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789518391.254357:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254366:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254372:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254378:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518391.254383:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254391:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254404:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:3.0:1789518391.254407:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518391.254427:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.254445:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c600/0x8d0fd679423159ea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518391.254494:0:17092:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001df109b5 reply state 000000008bad50db transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.256710:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.256723:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e743b22e800) 00010000:00010000:3.0:1789518391.256726:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789518391.256732:0:17092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518391.257145:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd679423159e3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 15 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.257179:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 14 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.257188:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:0.0:1789518391.257191:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789518391.257194:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:0.0:1789518391.257313:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+15:15567:x1876445501719296:12345-192.168.202.43@tcp:101:bash.0 Request processed in 17819us (18141us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789518391.257323:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:1.0:1789518391.289516:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522776192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518391.289619:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518391.289681:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518391.289689:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522776320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518391.289723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518391.289764:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522776192 00000100:00100000:1.0:1789518391.289774:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522776192 00000100:00100000:1.0:1789518391.289831:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522776320 00000100:00100000:1.0:1789518391.289835:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522776320 00000100:00100000:1.0:1789518391.289857:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518391.289867:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522776192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518391.289904:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789518391.289956:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522776192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.289964:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518391.289986:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518391.289993:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522776320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518391.290003:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789518391.290026:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522776320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.290068:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518391.290117:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522776320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518391.290132:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522776192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518391.294751:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00080000:3.0:1789518391.295381:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518391.295406:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522776704:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.295504:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518391.295544:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522777216:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.295566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518391.295580:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522777728:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.295596:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518391.295617:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789518391.295635:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522776832:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.295656:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518391.295672:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522777344:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.295690:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518391.295729:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522776704 00000100:00100000:3.0:1789518391.295738:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522776704 00000100:00100000:3.0:1789518391.296192:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518391.296205:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522776704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.296275:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522776704:12345-0@lo:400:kworker.0 Request processed in 73us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.296283:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789518391.296314:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518391.296353:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522776704:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.296381:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501719552 00000100:00100000:3.0:1789518391.296385:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501719552 00000100:00100000:3.0:1789518391.296410:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522777216 00000100:00100000:3.0:1789518391.296413:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522777216 00000100:00100000:3.0:1789518391.296425:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522777728 00000100:00100000:3.0:1789518391.296427:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522777728 00000100:00100000:3.0:1789518391.296449:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522776832 00000100:00100000:3.0:1789518391.296451:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522776832 00000100:00100000:3.0:1789518391.296500:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522777344 00000100:00100000:3.0:1789518391.296503:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522777344 00000100:00100000:3.0:1789518391.296521:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518391.296527:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522777216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.296564:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876445522777216:12345-0@lo:400:kworker.0 Request processed in 38us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.296571:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518391.296582:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518391.296588:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522777728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.296616:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876445522777728:12345-0@lo:400:kworker.0 Request processed in 28us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.296621:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518391.296654:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518391.296670:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522776832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.296836:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789518391.296848:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522777344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518391.296925:0:17091:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518391.296937:0:17091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789518391.297459:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522776448:0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.302189:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876445522777344:12345-0@lo:400:kworker.0 Request processed in 5315us (6467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518391.302211:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789518391.302272:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:0.0:1789518391.302291:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+15:15567:x1876445501719552:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789518391.302326:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518391.302355:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd67942315a06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665d6 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.302479:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.302496:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.303387:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518391.303515:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789518391.303520:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518391.303547:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.303562:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.303603:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d400/0x8d0fd67942315a06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 17 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.303644:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 16 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.303677:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:0.0:1789518391.303680:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518391.303686:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d000, rc 0) 00000100:00100000:0.0:1789518391.304089:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+16:15567:x1876445501719552:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1805us (9352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518391.304098:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:0.0:1789518391.307777:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522776576:0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.307896:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518391.307946:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522777088:0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.307976:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518391.307998:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522777600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.308025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518391.308091:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522776576 00000100:00100000:0.0:1789518391.308100:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522776576 00000100:00100000:0.0:1789518391.308169:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518391.308180:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522776576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518391.308188:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522777600 00000100:00100000:1.0:1789518391.308192:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522777600 00000100:00100000:1.0:1789518391.308235:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518391.308243:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522777600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.308250:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522776576:12345-0@lo:400:kworker.0 Request processed in 72us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518391.308257:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518391.308277:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876445522777600:12345-0@lo:400:kworker.0 Request processed in 36us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518391.308283:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789518391.308313:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522776576:0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.308324:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1876445522777600:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.309435:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876445522776832:12345-0@lo:400:kworker.0 Request processed in 12758us (13770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.309451:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789518391.309599:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00080000:3.0:1789518391.309883:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518391.309888:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518391.309935:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876445522776832:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.309952:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1876445522777344:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.309966:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876445522777216:0@lo:400:kworker.0 00010000:00080000:3.0:1789518391.309982:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7441295180 x1876445522777728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518391.309992:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1876445522777728:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.310059:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522777088 00000100:00100000:3.0:1789518391.310067:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522777088 00000100:00100000:3.0:1789518391.310114:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518391.310124:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522777088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.310208:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876445522777088:12345-0@lo:400:kworker.0 Request processed in 85us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.310214:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518391.310247:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1876445522777088:0@lo:400:kworker.0 00000100:00080000:3.0:1789518391.310261:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518391.310406:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518391.310489:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7435f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522776960:0@lo:400:kworker.0 00000100:00100000:2.0:1789518391.310530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518391.310562:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522777472:0@lo:400:kworker.0 00000100:00100000:2.0:1789518391.310589:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518391.310821:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522776448 00000100:00100000:0.0:1789518391.310833:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522776448 00000100:00100000:0.0:1789518391.310872:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789518391.310879:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:3639:x1876445522776448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518391.310920:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6224dd85-753f-4c3f-83da-7a6019473f75+24:3639:x1876445522776448:12345-0@lo:400:kworker.0 Request processed in 43us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518391.310926:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789518391.311048:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6224dd85-753f-4c3f-83da-7a6019473f75:3639:1876445522776448:0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.311331:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522776960 00000100:00100000:3.0:1789518391.311337:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522776960 00000100:00100000:3.0:1789518391.311374:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789518391.311381:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522776960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.311442:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522776960:12345-0@lo:400:kworker.0 Request processed in 62us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.311449:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789518391.311519:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522777472 00000100:00100000:3.0:1789518391.311523:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522777472 00000100:00080000:3.0:1789518391.311546:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789518391.311575:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518391.311582:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522777472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518391.311618:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876445522777472:12345-0@lo:400:kworker.0 Request processed in 37us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518391.311857:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518391.311963:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7435f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522776960:0@lo:400:kworker.0 00010000:00080000:2.0:1789518391.311976:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e7441294e00 x1876445522777472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518391.311986:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1876445522777472:0@lo:400:kworker.0 00000100:00100000:1.0:1789518391.314938:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501719808 00000100:00100000:1.0:1789518391.314961:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501719808 00000100:00100000:1.0:1789518391.315060:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:1.0:1789518391.315072:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+16:15567:x1876445501719808:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:1.0:1789518391.315513:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+17:15567:x1876445501719808:12345-192.168.202.43@tcp:35:bash.0 Request processed in 441us (5916us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789518391.315522:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:1.0:1789518391.456128:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518391.456806:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501720064 00000100:00100000:3.0:1789518391.456821:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501720064 00000100:00100000:3.0:1789518391.456909:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:3.0:1789518391.456921:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+17:15577:x1876445501720064:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518391.456958:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518391.456985:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665dd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518391.457124:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789518391.457264:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665dd expref: 19 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.457284:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e7441627900) 00010000:00010000:3.0:1789518391.457287:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518391.457293:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665dd expref: 19 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.457335:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030e00, rc 0) 00000100:00100000:3.0:1789518391.457434:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+18:15577:x1876445501720064:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 515us (1324us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789518391.457442:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:3.0:1789518391.467186:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518391.467322:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501720320 00000100:00100000:1.0:1789518391.467338:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501720320 00000100:00100000:1.0:1789518391.467419:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:1.0:1789518391.467431:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+18:15577:x1876445501720320:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789518391.467809:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+19:15577:x1876445501720320:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 378us (648us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789518391.467837:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00010000:00010000:1.0:1789518391.478333:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518391.534193:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518391.534347:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501720576 00000100:00100000:3.0:1789518391.534360:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501720576 00000100:00100000:3.0:1789518391.534448:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:3.0:1789518391.534487:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+19:15580:x1876445501720576:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789518391.534526:0:19376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518391.534553:0:19376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a22 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665e4 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.534743:0:19376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.534762:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.534777:0:19376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518391.534794:0:19376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789518391.534933:0:19376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a22 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665e4 expref: 22 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.534957:0:19376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665e4 expref: 21 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518391.534975:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518391.534978:0:19376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518391.534982:0:19376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031e00, rc 0) 00000100:00100000:3.0:1789518391.535078:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+21:15580:x1876445501720576:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 619us (899us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789518391.535086:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:0.0:1789518391.541777:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518391.544671:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501720704 00000100:00100000:2.0:1789518391.544695:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501720704 00000100:00100000:2.0:1789518391.544808:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:2.0:1789518391.544821:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+21:15580:x1876445501720704:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789518391.544922:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.544944:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.544959:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.545014:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.545022:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.545040:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.545068:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033acc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518391.545073:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.545082:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.545096:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518391.545099:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518391.545104:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.545110:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518391.545218:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+21:15580:x1876445501720704:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 400us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518391.545227:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:2.0:1789518391.547203:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518391.548008:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501720832 00000100:00100000:0.0:1789518391.548025:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501720832 00000100:00100000:0.0:1789518391.548131:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789518391.548144:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+21:2388:x1876445501720832:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518391.548166:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518391.548197:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a29 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665e4 expref: 21 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.548221:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:0.0:1789518391.548228:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518391.548318:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+20:2388:x1876445501720832:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 177us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518391.548327:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:1.0:1789518391.554180:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518391.554712:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501721088 00000100:00100000:0.0:1789518391.554727:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501721088 00000100:00100000:0.0:1789518391.554962:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789518391.554976:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+20:15580:x1876445501721088:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789518391.555283:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+21:15580:x1876445501721088:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 309us (1116us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789518391.555312:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:1.0:1789518391.913267:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518391.913520:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501721344 00000100:00100000:0.0:1789518391.913534:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501721344 00000100:00100000:0.0:1789518391.913609:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789518391.913632:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+21:15611:x1876445501721344:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:0.0:1789518391.913666:0:20230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518391.913848:0:20230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315a3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665eb expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.914021:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315a45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.914050:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315a45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.914067:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315a45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518391.914083:0:20230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789518391.914257:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315a3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665eb expref: 24 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.914282:0:20230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315a45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665eb expref: 23 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518391.914292:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:0.0:1789518391.914295:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518391.914300:0:20230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9c200, rc 0) 00000100:00100000:0.0:1789518391.914388:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+23:15611:x1876445501721344:12345-192.168.202.43@tcp:101:cat.0 Request processed in 768us (1137us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789518391.914397:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:2.0:1789518391.918152:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518391.918735:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501721600 00000100:00100000:0.0:1789518391.918751:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501721600 00000100:00100000:0.0:1789518391.918816:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789518391.918827:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+23:15611:x1876445501721600:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:0.0:1789518391.919224:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+24:15611:x1876445501721600:12345-192.168.202.43@tcp:35:cat.0 Request processed in 397us (1083us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789518391.919242:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789518391.922950:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518391.923083:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501721728 00000100:00100000:2.0:1789518391.923098:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501721728 00000100:00100000:2.0:1789518391.923189:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:2.0:1789518391.923202:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+24:2387:x1876445501721728:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518391.923223:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518391.923267:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315a45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665eb expref: 24 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518391.923319:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518391.923327:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518391.923410:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+23:2387:x1876445501721728:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 211us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518391.923419:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00000040:00080000:1.0:1789518391.990964:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789518392.010438:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518392.010568:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501721984 00000100:00100000:3.0:1789518392.010583:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501721984 00000100:00100000:3.0:1789518392.010698:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:3.0:1789518392.010712:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+23:15617:x1876445501721984:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:3.0:1789518392.010747:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518392.010773:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a53 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665f2 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.010919:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.010937:0:17092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.010946:0:17092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 24 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.010956:0:17092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.010999:0:17092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 24 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.011041:0:17092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 24 pid: 17090 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518392.011056:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17092:1876445522777856:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518392.011173:0:17092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.011182:0:17092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 24 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518392.011191:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441297100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17092:1876445522777984:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789518392.011215:0:17092:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406d8d3c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789518392.011428:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518392.021844:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17092:1876445522777856:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518392.030259:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518392.030534:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501722112 00000100:00100000:0.0:1789518392.030549:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501722112 00010000:00010000:0.0:1789518392.030613:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 25 pid: 17090 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518392.030662:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:0.0:1789518392.030674:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+25:2387:x1876445501722112:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518392.030704:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518392.030714:0:17076:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 25 pid: 17090 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.030730:0:17076:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 25 pid: 17090 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.030759:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665d6 expref: 25 pid: 17090 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.030809:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:0.0:1789518392.030815:0:17076:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.030824:0:17076:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.030832:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518392.030918:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+24:2387:x1876445501722112:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 245us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518392.030927:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:1.0:1789518392.032180:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518392.032373:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501722240 00000100:00100000:2.0:1789518392.032383:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501722240 00010000:00010000:2.0:1789518392.032423:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 24 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518392.032500:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:2.0:1789518392.032510:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7404db5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+24:2387:x1876445501722240:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518392.032524:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518392.032531:0:17077:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 24 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.032545:0:17077:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 24 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.032566:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518392.032572:0:17077:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.032582:0:17077:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.032590:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.032634:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518392.032685:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7404db5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+24:2387:x1876445501722240:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 176us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518392.032702:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00010000:00010000:3.0:1789518392.032982:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd679423159f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665cf expref: 23 pid: 17092 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518392.033009:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441297100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17092:1876445522777984:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518392.033056:0:17092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.033068:0:17092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.033075:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518392.033115:0:17092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789518392.033366:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a53 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f2 expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.033386:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031800/0x8d0fd67942315a5a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f2 expref: 23 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.033395:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518392.033398:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518392.033401:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400031800, rc 0) 00000100:00100000:3.0:1789518392.033440:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+23:15617:x1876445501721984:12345-192.168.202.43@tcp:101:dd.0 Request processed in 22733us (23017us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789518392.033449:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:1.0:1789518392.045619:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518392.045795:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501722368 00000100:00100000:3.0:1789518392.045808:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501722368 00000100:00100000:3.0:1789518392.045881:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:3.0:1789518392.045891:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+23:15617:x1876445501722368:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:3.0:1789518392.045923:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518392.045949:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a68 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc785665f9 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.045993:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.046012:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.046059:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.046206:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 25 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.046458:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.046588:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518392.046591:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518392.046595:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7400030800, rc 0) 00000100:00100000:3.0:1789518392.046670:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+24:15617:x1876445501722368:12345-192.168.202.43@tcp:101:dd.0 Request processed in 780us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518392.046679:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:0.0:1789518392.050436:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518392.050559:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501722624 00000100:00100000:2.0:1789518392.050573:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501722624 00000100:00100000:2.0:1789518392.050648:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:2.0:1789518392.050659:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+24:15617:x1876445501722624:12345-192.168.202.43@tcp:36:dd.0 00010000:00010000:2.0:1789518392.050945:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.050964:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.050978:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518392.051035:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789518392.051060:0:20230:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000812575a3 reply state 00000000a34234a5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.051074:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.051082:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518392.051085:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789518392.051090:0:20230:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518392.051197:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+27:15617:x1876445501722624:12345-192.168.202.43@tcp:36:dd.0 Request processed in 539us (774us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789518392.051223:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000020:00080000:2.0:1789518392.051229:0:20230:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789518392.053955:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518392.054034:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501722752 00000100:00100000:0.0:1789518392.054048:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501722752 00000100:00100000:0.0:1789518392.054123:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:0.0:1789518392.054135:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+27:15617:x1876445501722752:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:0.0:1789518392.054169:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518392.054197:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566600 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.054281:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566600 expref: 28 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.054300:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566600 expref: 28 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518392.054323:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:0.0:1789518392.054346:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518392.054352:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d000, rc 0) 00000100:00100000:0.0:1789518392.054421:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15617:x1876445501722752:12345-192.168.202.43@tcp:101:dd.0 Request processed in 288us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518392.054428:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:0.0:1789518392.073520:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518392.073674:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501723008 00000100:00100000:3.0:1789518392.073699:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501723008 00000100:00100000:3.0:1789518392.073791:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:3.0:1789518392.073803:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15617:x1876445501723008:12345-192.168.202.43@tcp:103:dd.0 00010000:00010000:3.0:1789518392.073822:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518392.073854:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315a7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566600 expref: 28 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.073880:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518392.073886:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518392.073950:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+27:15617:x1876445501723008:12345-192.168.202.43@tcp:103:dd.0 Request processed in 150us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518392.073976:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:0.0:1789518392.076835:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518392.077159:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501723136 00000100:00100000:3.0:1789518392.077174:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501723136 00000100:00100000:3.0:1789518392.077256:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:3.0:1789518392.077268:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+27:15617:x1876445501723136:12345-192.168.202.43@tcp:58:dd.0 00010000:00010000:3.0:1789518392.077408:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.077430:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518392.077442:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518392.079360:0:17091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518392.079861:0:17091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789518392.080011:0:17091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789518392.080217:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+27:15617:x1876445501723136:12345-192.168.202.43@tcp:58:dd.0 Request processed in 2943us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518392.080242:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:1.0:1789518392.084073:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518392.084203:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501723264 00000100:00100000:2.0:1789518392.084216:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501723264 00000100:00100000:2.0:1789518392.084563:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:2.0:1789518392.084576:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+27:15617:x1876445501723264:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:2.0:1789518392.084605:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518392.084646:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566607 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.084728:0:17090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.084741:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 28 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.084765:0:17090:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.084782:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 28 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.084798:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518392.084801:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518392.084806:0:17090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 28 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518392.084815:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ad800, rc 0) 00000100:00100000:2.0:1789518392.084919:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15617:x1876445501723264:12345-192.168.202.43@tcp:101:dd.0 Request processed in 346us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518392.084927:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00010000:00010000:3.0:1789518392.503888:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518393.013977:0:17125:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789518393.013989:0:17125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518393.014029:0:17125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789518393.014041:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789518393.014220:0:17125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17125:1876445522778112:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518393.014416:0:17125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d81540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518393.038341:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.038841:0:17125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f981f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17125:1876445522778112:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518393.039591:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501723392 00000100:00100000:0.0:1789518393.039603:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501723392 00000100:00100000:0.0:1789518393.039694:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:0.0:1789518393.039706:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15619:x1876445501723392:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518393.039764:0:19376:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518393.039925:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15619:x1876445501723392:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 221us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.039934:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:0.0:1789518393.054106:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.054201:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501723520 00000100:00100000:3.0:1789518393.054217:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501723520 00000100:00100000:3.0:1789518393.054302:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:3.0:1789518393.054314:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15619:x1876445501723520:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518393.054421:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.054515:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.054534:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055436:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055528:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055544:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055582:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055592:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055599:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518393.055816:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789518393.055821:0:17091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789518393.055933:0:17091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055946:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055969:0:17091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055975:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055982:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518393.055986:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.055994:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056006:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7303358700) 00010000:00010000:3.0:1789518393.056009:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518393.056025:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056032:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031e00/0x8d0fd67942315a92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056049:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056055:0:17091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056060:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056065:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518393.056074:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056080:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056087:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e743b22e600) 00010000:00010000:3.0:1789518393.056090:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518393.056093:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056099:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031000/0x8d0fd67942315a99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056115:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056120:0:17091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056126:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056131:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518393.056134:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056140:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056146:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518393.056148:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518393.056158:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.056164:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315aa0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.059517:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15619:x1876445501723520:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 5189us (5410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518393.059535:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:3.0:1789518393.078151:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.078282:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501723776 00000100:00100000:2.0:1789518393.078294:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501723776 00000100:00100000:2.0:1789518393.078407:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:2.0:1789518393.078419:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+28:15619:x1876445501723776:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518393.078441:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518393.078461:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942315aa7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856660e expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.078595:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.078611:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.078622:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518393.078633:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789518393.082525:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082544:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082552:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082558:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166d200 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.082575:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082582:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082599:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518393.082602:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518393.082606:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082612:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315aae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082673:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942315aa7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856660e expref: 30 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082684:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e7303358700) 00010000:00010000:2.0:1789518393.082686:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518393.082690:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ac200/0x8d0fd67942315aa7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856660e expref: 30 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.082698:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e73033ac200, rc 0) 00000100:00100000:2.0:1789518393.082765:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+29:15619:x1876445501723776:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 4348us (4625us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789518393.082774:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:1.0:1789518393.101054:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.102106:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501723904 00000100:00100000:0.0:1789518393.102119:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501723904 00000100:00100000:0.0:1789518393.102179:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:0.0:1789518393.102189:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+29:15619:x1876445501723904:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518393.102225:0:19376:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518393.102349:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+29:15619:x1876445501723904:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 161us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.102357:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:1.0:1789518393.122076:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.122206:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501724160 00000100:00100000:2.0:1789518393.122217:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501724160 00000100:00100000:2.0:1789518393.122286:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:2.0:1789518393.122297:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+29:15619:x1876445501724160:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518393.122333:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518393.122354:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315abc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566615 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518393.123079:0:17091:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1789518393.123086:0:17091:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789518393.123106:0:17091:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789518393.123251:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315ac3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.124601:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.124627:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.124931:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d200/0x8d0fd67942315abc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566615 expref: 32 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.124977:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566615 expref: 31 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.124986:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e73010b5300) 00010000:00010000:0.0:1789518393.124989:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518393.124992:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166d400, rc 0) 00000100:00100000:0.0:1789518393.125079:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+31:15619:x1876445501724160:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 2783us (3012us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789518393.125088:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:1.0:1789518393.140689:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.140997:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501724416 00000100:00100000:2.0:1789518393.141008:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501724416 00000100:00100000:2.0:1789518393.141086:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:2.0:1789518393.141096:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+31:15619:x1876445501724416:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518393.141175:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518393.141204:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315ac3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566615 expref: 31 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.141225:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e73010b5300) 00010000:00010000:2.0:1789518393.141236:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518393.141258:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.141295:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.141307:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.141322:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.141329:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.141347:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142100:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142110:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142117:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142122:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166ca00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.142126:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142133:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142143:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:2.0:1789518393.142152:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518393.142157:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142163:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166ca00/0x8d0fd67942315ad1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142175:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142181:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142187:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142191:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166c000 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.142194:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142198:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142205:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9053b90c (ffff8e73010b5c00) 00010000:00010000:2.0:1789518393.142207:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518393.142210:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.142214:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c000/0x8d0fd67942315ad8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9053b90c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518393.142307:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7410738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+30:15619:x1876445501724416:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 1211us (1638us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518393.142320:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:1.0:1789518393.168553:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.169198:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501724544 00000100:00100000:3.0:1789518393.169210:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501724544 00000100:00100000:3.0:1789518393.169274:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:3.0:1789518393.169286:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+30:15619:x1876445501724544:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518393.169552:0:17092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518393.169578:0:17092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315adf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856661c expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.169620:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2a00/0x8d0fd67942315ae6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.169634:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2a00/0x8d0fd67942315ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.169647:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2a00/0x8d0fd67942315ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.169764:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315adf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856661c expref: 32 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.169798:0:17092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c2a00/0x8d0fd67942315ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856661c expref: 31 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.169807:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:3.0:1789518393.169811:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518393.169814:0:17092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e74421c2a00, rc 0) 00000100:00100000:3.0:1789518393.169895:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+31:15619:x1876445501724544:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 612us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518393.169903:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:1.0:1789518393.179008:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.179148:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501724800 00000100:00100000:0.0:1789518393.179158:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501724800 00000100:00100000:0.0:1789518393.179229:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:0.0:1789518393.179240:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+31:15619:x1876445501724800:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518393.179590:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.179674:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.179752:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518393.179991:0:17091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789518393.180002:0:17091:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 560965537610ns, next at 561965535042ns, rc = 0 00000004:00010000:0.0:1789518393.181092:0:17091:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000356b026e reply state 00000000fa9c17f6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.181131:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.181140:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:0.0:1789518393.181143:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789518393.181148:0:17091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518393.181652:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+33:15619:x1876445501724800:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 2136us (2376us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789518393.181663:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:1.0:1789518393.193484:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.194071:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501724928 00000100:00100000:0.0:1789518393.194082:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501724928 00000100:00100000:0.0:1789518393.194154:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:0.0:1789518393.194164:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+33:15619:x1876445501724928:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518393.194188:0:19376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518393.194208:0:19376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566623 expref: -99 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.194268:0:19376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 34 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.194285:0:19376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 34 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.194304:0:19376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:0.0:1789518393.194308:0:19376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518393.194312:0:19376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d800, rc 0) 00000100:00100000:0.0:1789518393.194461:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+34:15619:x1876445501724928:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 215us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.194560:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:1.0:1789518393.197898:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.198051:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501725056 00000100:00100000:3.0:1789518393.198062:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501725056 00000100:00100000:3.0:1789518393.198134:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:3.0:1789518393.198144:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2387:x1876445501725056:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789518393.198393:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2387:x1876445501725056:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 249us (502us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789518393.198401:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00080000:0.0:1789518393.199657:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518393.214579:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.214772:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501725312 00000100:00100000:0.0:1789518393.214783:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501725312 00000100:00100000:0.0:1789518393.214851:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:0.0:1789518393.214862:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+34:15619:x1876445501725312:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518393.215099:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+35:15619:x1876445501725312:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 238us (531us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789518393.215107:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789518393.218211:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.218315:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501725568 00000100:00100000:3.0:1789518393.218326:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501725568 00000100:00100000:3.0:1789518393.218384:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:3.0:1789518393.218394:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+35:15619:x1876445501725568:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789518393.218546:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+35:15619:x1876445501725568:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 152us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518393.218553:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:1.0:1789518393.229142:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.229539:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501725696 00000100:00100000:0.0:1789518393.229550:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501725696 00000100:00100000:0.0:1789518393.229622:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:0.0:1789518393.229633:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+35:15619:x1876445501725696:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518393.229653:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518393.229673:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315afb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc7856662a expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.229914:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315b02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.229929:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.229943:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518393.229988:0:17091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789518393.230035:0:17091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.230064:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315afb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856662a expref: 37 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.230086:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315b02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856662a expref: 36 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.230095:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:0.0:1789518393.230097:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789518393.230102:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f9d000, rc 0) 00000100:00100000:0.0:1789518393.230168:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+36:15619:x1876445501725696:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 536us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.230175:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:0.0:1789518393.235064:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.235411:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501725824 00000100:00100000:3.0:1789518393.235434:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501725824 00000100:00100000:2.0:1789518393.236003:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:2.0:1789518393.236028:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2388:x1876445501725824:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518393.236046:0:18597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518393.236067:0:18597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566631 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518393.236093:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e239, blocks: 0x0 00010000:00010000:2.0:1789518393.236113:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789518393.236118:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518393.236127:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 7 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.236146:0:18597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 7 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.236160:0:18597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e740166ca00, rc 0) 00000100:00100000:2.0:1789518393.236223:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:2388:x1876445501725824:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 211us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518393.236243:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:1.0:1789518393.246085:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.246252:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501726080 00000100:00100000:3.0:1789518393.246263:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501726080 00000100:00100000:3.0:1789518393.246317:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:3.0:1789518393.246329:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+36:15619:x1876445501726080:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789518393.246428:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7435e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+36:15619:x1876445501726080:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 101us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518393.246436:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:1.0:1789518393.248853:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.248983:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501726208 00000100:00100000:3.0:1789518393.248992:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501726208 00000100:00100000:3.0:1789518393.249055:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:3.0:1789518393.249065:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+36:15619:x1876445501726208:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789518393.251775:0:17070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1789518393.251791:0:17070:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789518393.251908:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.251922:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.251942:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.251949:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9cc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.251953:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.251962:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.251978:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e7303358d00) 00010000:00010000:2.0:1789518393.251981:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518393.251987:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.251993:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9cc00/0x8d0fd67942315942 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252027:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252034:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252040:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252044:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9c400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.252047:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252062:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252071:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:2.0:1789518393.252073:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518393.252076:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252083:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c400/0x8d0fd67942315949 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252096:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252102:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252108:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252113:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400031600 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.252116:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252121:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252128:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e743b22e800) 00010000:00010000:2.0:1789518393.252130:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518393.252133:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252144:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400031600/0x8d0fd679423159f1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252159:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252165:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252170:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252175:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e73033acc00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.252178:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252184:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252191:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518393.252193:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518393.252196:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252201:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033acc00/0x8d0fd67942315a76 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252212:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252217:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252229:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252233:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ce00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:2.0:1789518393.252236:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252242:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252249:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:2.0:1789518393.252251:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518393.252254:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.252259:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9ce00/0x8d0fd67942315aed lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518393.260941:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522778240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789518393.261037:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518393.261101:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522778240 00000100:00100000:2.0:1789518393.261110:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522778240 00000100:00100000:2.0:1789518393.261167:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518393.261176:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522778240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789518393.261323:0:18596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789518393.261327:0:18596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789518393.261329:0:18596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518393.261331:0:18596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789518393 -> 1789518393 00002000:00010000:2.0:1789518393.261333:0:18596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789518393.261390:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876445522778240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (354us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789518393.261398:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789518393.261419:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789518393.261450:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e7441295f80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789518393.261457:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522778240:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1789518393.262019:0:17070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1789518393.262130:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.262141:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.262149:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.262155:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:1.0:1789518393.262159:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.262167:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.262182:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e7303358a00) 00010000:00010000:1.0:1789518393.262185:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789518393.262190:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.262197:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030400/0x8d0fd67942315996 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518393.262350:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+15:15619:x1876445501726208:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 13285us (13502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518393.262359:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:3.0:1789518393.267653:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.267748:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501726336 00000100:00100000:0.0:1789518393.267759:0:18595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501726336 00000100:00100000:0.0:1789518393.267816:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:0.0:1789518393.267827:0:18595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:2387:x1876445501726336:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789518393.268502:0:18595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:2387:x1876445501726336:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 638us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.268511:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:1.0:1789518393.275587:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.275939:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501726592 00000100:00100000:0.0:1789518393.275950:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501726592 00000100:00100000:0.0:1789518393.276040:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:0.0:1789518393.276051:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+15:15619:x1876445501726592:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518393.276111:0:17091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518393.276137:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d000/0x8d0fd67942315b02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc7856662a expref: 15 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.276159:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:0.0:1789518393.276163:0:17091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518393.276189:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315b10 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.276203:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315b10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.276213:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315b10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518393.276357:0:17091:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b92ccc2f reply state 00000000fad69b9a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315b10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.276371:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9c200/0x8d0fd67942315b10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.277008:0:17091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:0.0:1789518393.277019:0:17091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789518393.277023:0:17091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518393.278348:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+16:15619:x1876445501726592:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 1627us (2099us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789518393.278373:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:1.0:1789518393.281224:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.281313:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501726720 00000100:00100000:2.0:1789518393.281324:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501726720 00000100:00100000:2.0:1789518393.281384:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:2.0:1789518393.281395:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+7:2388:x1876445501726720:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518393.281586:0:18596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789518393.281590:0:18596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789518391 00002000:00010000:2.0:1789518393.281592:0:18596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789518391 00002000:00010000:2.0:1789518393.281594:0:18596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789518393 -> 1789518391 00002000:00010000:2.0:1789518393.281597:0:18596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789518393.281668:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+8:2388:x1876445501726720:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 275us (450us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789518393.281675:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:3.0:1789518393.284898:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.285185:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501726848 00000100:00100000:2.0:1789518393.285199:0:18597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501726848 00000100:00100000:2.0:1789518393.285260:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:2.0:1789518393.285271:0:18597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+8:2388:x1876445501726848:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518393.285347:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285385:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518393.285390:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518393.285397:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285412:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285439:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285448:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285456:0:18597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285483:0:18597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166d400 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:2.0:1789518393.285487:0:18597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285496:0:18597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285511:0:18597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.285523:0:18597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb13d0e/0x8d0fd67942315b17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518393.285589:0:18597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+8:2388:x1876445501726848:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 320us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518393.285596:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:3.0:1789518393.297550:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.297646:0:20230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501727104 00000100:00100000:2.0:1789518393.297657:0:20230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501727104 00000100:00100000:2.0:1789518393.297718:0:20230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:2.0:1789518393.297728:0:20230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+16:15619:x1876445501727104:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789518393.297809:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.297828:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 16 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.297850:0:20230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.297884:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 16 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.297898:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 16 pid: 17091 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518393.297912:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20230:1876445522778368:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518393.298021:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74206b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518393.300243:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20230:1876445522778368:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518393.300275:0:20230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.304976:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.305345:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501727232 00000100:00100000:2.0:1789518393.305357:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501727232 00010000:00010000:2.0:1789518393.305413:0:17077:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 17 pid: 17091 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518393.305460:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:2.0:1789518393.305512:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+17:2388:x1876445501727232:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518393.305530:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518393.305538:0:17077:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 17 pid: 17091 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.305552:0:17077:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 17 pid: 17091 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.305574:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030800/0x8d0fd67942315a6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc785665f9 expref: 17 pid: 17091 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.305592:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:2.0:1789518393.305598:0:17077:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 16 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.305608:0:17077:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.305844:0:17077:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.305852:0:17077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.307020:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518393.307090:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+16:2388:x1876445501727232:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 1578us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518393.307100:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00010000:00010000:2.0:1789518393.308775:0:20230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.308790:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.309245:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.309263:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 16 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.309272:0:20230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.309327:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 16 pid: 19376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.309343:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 16 pid: 19376 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518393.309358:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20230:1876445522778496:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789518393.309541:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e73029efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518393.327146:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789518393.327343:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20230:1876445522778496:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789518393.327376:0:20230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.327503:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501727360 00000100:00100000:3.0:1789518393.327511:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501727360 00010000:00010000:3.0:1789518393.327548:0:17076:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 17 pid: 19376 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.327584:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:3.0:1789518393.327592:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+17:2388:x1876445501727360:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518393.327630:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518393.327637:0:17076:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 17 pid: 19376 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.327648:0:17076:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 17 pid: 19376 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.327670:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9d800/0x8d0fd67942315af4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566623 expref: 17 pid: 19376 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.327853:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:3.0:1789518393.327859:0:17076:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.327869:0:17076:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.327876:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.327903:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518393.327955:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+16:2388:x1876445501727360:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 363us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518393.327963:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00010000:00010000:2.0:1789518393.329029:0:20230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518393.329042:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518393.329156:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789518393.329275:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789518393.329329:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789518393.329413:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20230:1876445522778624:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789518393.329520:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518393.329544:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74414d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518393.330128:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522778624 00000100:00100000:0.0:1789518393.330137:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522778624 00000100:00100000:0.0:1789518393.330193:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518393.330203:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20230:x1876445522778624:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789518393.330333:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20230:x1876445522778624:12345-0@lo:1000:mdt00_004.0 Request processed in 131us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.330343:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789518393.330434:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20230:1876445522778624:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789518393.330598:0:20230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789518393.331050:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7303d60380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20230:1876445522778752:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789518393.331080:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518393.331103:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e74414d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518393.331210:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522778752 00000100:00100000:0.0:1789518393.331216:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522778752 00000100:00100000:0.0:1789518393.331247:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789518393.331255:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20230:x1876445522778752:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789518393.331386:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20230:x1876445522778752:12345-0@lo:1000:mdt00_004.0 Request processed in 131us (304us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789518393.331393:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789518393.331734:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7303d60380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20230:1876445522778752:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789518393.331788:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.331798:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.331815:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.331821:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166c400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518393.331825:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332198:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332217:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:3.0:1789518393.332220:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518393.332225:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332242:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166c400/0x8d0fd67942315b25 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332276:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332282:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332288:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332393:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7400030e00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518393.332397:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332415:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332425:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518393.332428:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518393.332435:0:20230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 19 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332446:0:20230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 19 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332455:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 19 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.332539:0:20230:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e73033ad800/0x8d0fd67942315a8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566607 expref: 19 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.332551:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441296680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20230:1876445522778880:192.168.202.43@tcp:105: 00000100:00100000:3.0:1789518393.333070:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7406d8d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518393.348364:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.348527:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441296680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20230:1876445522778880:192.168.202.43@tcp:105: 00010000:00010000:3.0:1789518393.348562:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348574:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7400030e00/0x8d0fd67942315a84 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348642:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348672:0:20230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348694:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348708:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348714:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348720:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348726:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e74421c3c00 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518393.348730:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348737:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348749:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518393.348752:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518393.348756:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348762:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e74421c3c00/0x8d0fd67942315b2c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348772:0:20230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348786:0:20230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348792:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348797:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e740166d400 already unused, calling callback (ffffffffc17e44f0) 00010000:00010000:3.0:1789518393.348800:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348805:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348813:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:3.0:1789518393.348815:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518393.348818:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.348824:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e740166d400/0x8d0fd67942315b1e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.349037:0:20230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+19:15619:x1876445501727104:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 51309us (51493us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789518393.349047:0:20230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000020:00080000:3.0:1789518393.349055:0:20230:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789518393.349410:0:17125:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789518393.349416:0:17125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518393.349431:0:17125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789518393.349450:0:17125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789518393.353713:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.367570:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501727488 00000100:00100000:0.0:1789518393.367589:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501727488 00000100:00100000:0.0:1789518393.367667:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501727744 00000100:00100000:0.0:1789518393.367670:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501727744 00000100:00100000:0.0:1789518393.367864:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:0.0:1789518393.367876:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7406dee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+20:15617:x1876445501727488:12345-192.168.202.43@tcp:49:dd.0 00000100:00100000:0.0:1789518393.368039:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7406dee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+20:15617:x1876445501727488:12345-192.168.202.43@tcp:49:dd.0 Request processed in 165us (19685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.368046:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:0.0:1789518393.368099:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:0.0:1789518393.368106:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+19:15619:x1876445501727744:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518393.371985:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518393.372130:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501727872 00000100:00100000:1.0:1789518393.372141:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501727872 00000100:00100000:1.0:1789518393.372201:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:1.0:1789518393.372209:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+21:15617:x1876445501727872:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:1.0:1789518393.372230:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518393.372251:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942315b33 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3c6c92dc78566638 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.372284:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315b3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.372299:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315b3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.372311:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315b3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.372430:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c800/0x8d0fd67942315b33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566638 expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.372450:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f0c400/0x8d0fd67942315b3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566638 expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.372500:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e743b22eb00) 00010000:00010000:1.0:1789518393.372503:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518393.372507:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e7435f0c400, rc 0) 00000100:00100000:1.0:1789518393.372568:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+22:15617:x1876445501727872:12345-192.168.202.43@tcp:101:dd.0 Request processed in 359us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518393.372575:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000004:00080000:0.0:1789518393.373271:0:17093:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518393.373315:0:17093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789518393.373369:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.373391:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.373400:0:17093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.373408:0:17093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.373415:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.373421:0:17093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.373445:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518393.373523:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+22:15619:x1876445501727744:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 5417us (19819us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789518393.373531:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000020:00080000:0.0:1789518393.373535:0:17093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518393.375743:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518393.375756:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.375766:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9da00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:1.0:1789518393.375770:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.375779:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.375796:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e743b22e600) 00010000:00010000:1.0:1789518393.375799:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518393.375803:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.375809:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e7435f9da00/0x8d0fd67942315b41 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.375827:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518393.375828:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518393.375830:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518393.525966:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518393.649203:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.649259:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789518393.650064:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728128 00000100:00100000:1.0:1789518393.650086:0:18600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728128 00000100:00100000:1.0:1789518393.650150:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728000 00000100:00100000:1.0:1789518393.650153:0:18600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728000 00000100:00100000:1.0:1789518393.650172:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:1.0:1789518393.650181:0:18600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:2387:x1876445501728128:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:1.0:1789518393.650216:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.650236:0:18600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 9 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.650246:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518393.650250:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518393.650256:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.650290:0:18600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 9 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.650317:0:18600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 9 pid: 18597 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518393.650331:0:18600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18600:1876445522779008:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789518393.650419:0:18600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e7303d81480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518393.657617:0:18600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18600:1876445522779008:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789518393.657666:0:18600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518393.657888:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789518393.658129:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728256 00000100:00100000:3.0:1789518393.658136:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728256 00010000:00010000:3.0:1789518393.658173:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 10 pid: 18597 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.658218:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:3.0:1789518393.658237:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+10:2387:x1876445501728256:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518393.658252:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518393.658275:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 10 pid: 18597 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.658289:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 10 pid: 18597 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.658314:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107b2dfb/0x8d0fd67942315b09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x3c6c92dc78566631 expref: 10 pid: 18597 timeout: 661 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.658332:0:17075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518393.658337:0:17075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518393.658343:0:17075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.658352:0:17075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518393.659564:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518393.659658:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+9:2387:x1876445501728256:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 1427us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518393.659667:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00010000:00010000:0.0:1789518393.660400:0:18600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.660414:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518393.750808:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.751027:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.751054:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.751103:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728512 00000100:00100000:0.0:1789518393.751117:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728512 00000100:00100000:0.0:1789518393.751181:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501729024 00000100:00100000:0.0:1789518393.751184:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501729024 00000100:00100000:0.0:1789518393.751222:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:0.0:1789518393.751235:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+22:2388:x1876445501728512:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518393.751340:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+22:2388:x1876445501728512:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 107us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.751349:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:0.0:1789518393.751370:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:0.0:1789518393.751377:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501729024:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518393.751405:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501729024:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.751411:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:0.0:1789518393.751452:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.751522:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728768 00000100:00100000:0.0:1789518393.751527:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728768 00000100:00100000:0.0:1789518393.751555:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501729280 00000100:00100000:0.0:1789518393.751558:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501729280 00000100:00100000:0.0:1789518393.751580:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:0.0:1789518393.751587:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501728768:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518393.751615:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501728768:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.751622:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:0.0:1789518393.751634:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789518393.751640:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501729280:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518393.751691:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e73033e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501729280:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.751698:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789518393.751775:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.751802:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.751822:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.751834:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728640 00000100:00100000:0.0:1789518393.751837:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728640 00000100:00100000:0.0:1789518393.751858:0:19376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728896 00000100:00100000:0.0:1789518393.751861:0:19376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728896 00000100:00100000:0.0:1789518393.751874:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:0.0:1789518393.751879:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501728640:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518393.751901:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2388:x1876445501728640:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 21us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.751907:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:0.0:1789518393.751917:0:19376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:0.0:1789518393.751922:0:19376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2388:x1876445501728896:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518393.751942:0:19376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+6:2388:x1876445501728896:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 20us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.751948:0:19376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:0.0:1789518393.752001:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789518393.752033:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501729152 00000100:00100000:0.0:1789518393.752037:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501729152 00000100:00100000:0.0:1789518393.752065:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:0.0:1789518393.752071:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501729152:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789518393.752108:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d7d9db62-953a-469d-a3cd-bfca7d59ab89+5:2388:x1876445501729152:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.752115:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00080000:2.0:1789518393.757172:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518393.757188:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518393.757192:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518393.757196:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789518393.757411:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445501728384 00000100:00100000:1.0:1789518393.757427:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445501728384 00000100:00100000:1.0:1789518393.757577:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 168 00000100:00100000:1.0:1789518393.757590:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e744160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:2388:x1876445501728384:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789518393.757732:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e744160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38d0052-52dc-405f-a9d4-0f80e8f0dd25+13:2388:x1876445501728384:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 145us (5955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518393.757742:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 168 00000001:00080000:2.0:1789518393.788936:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1789518393.789073:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1789518393.789769:0:18600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1789518393.789777:0:18600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789518391 -> 1789518393 00002000:00010000:0.0:1789518393.789780:0:18600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789518391 -> 1789518393 00002000:00010000:0.0:1789518393.789782:0:18600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1789518393.789804:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.789819:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.789829:0:18600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.789838:0:18600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f0c800 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518393.789843:0:18600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.789854:0:18600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.789878:0:18600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.789904:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff3479a/0x8d0fd67942315b48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518393.790242:0:18600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+6:2387:x1876445501728128:12345-192.168.202.43@tcp:4:dd.0 Request processed in 140052us (141039us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789518393.790260:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789518393.790313:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:0.0:1789518393.790331:0:18600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2387:x1876445501728000:12345-192.168.202.43@tcp:4:dd.0 00002000:00010000:0.0:1789518393.790389:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 7654321, mtime: 0x6aa9e239, atime: 0x6aa9e237, ctime: 0x6aa9e239, blocks: 0x1a68 00010000:00010000:0.0:1789518393.790398:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.790412:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1789518393.790418:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518393.790426:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.790439:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518393.847664:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522779136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789518393.847761:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518393.848883:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522779136 00000100:00100000:0.0:1789518393.848899:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522779136 00000100:00100000:0.0:1789518393.849030:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518393.849044:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522779136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789518393.849080:0:18598:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 30543552 pending 4218880 free 3923513344 avail 3688505344 00000100:00100000:0.0:1789518393.849444:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522779136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 403us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518393.849453:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789518393.850212:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518393.851580:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522779136:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1789518393.923611:0:18591:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1789518393.923985:0:18600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1789518393.924021:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.924037:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.924047:0:18600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.924056:0:18600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e7435f9ce00 already unused, calling callback (ffffffffc0bd28b0) 00010000:00010000:0.0:1789518393.924063:0:18600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.924074:0:18600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.924099:0:18600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.924107:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cedd34e5/0x8d0fd67942315b4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518393.924516:0:18600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0c36d3b-fdd7-44d5-bda3-4d0dbdd54e23+5:2387:x1876445501728000:12345-192.168.202.43@tcp:4:dd.0 Request processed in 134135us (275196us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789518393.924544:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00000040:00080000:0.0:1789518394.231094:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789518394.360756:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522779264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789518394.360860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518394.360928:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522779264 00000100:00100000:0.0:1789518394.360939:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522779264 00000100:00100000:0.0:1789518394.360993:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789518394.361016:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522779264:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789518394.361020:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522779392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789518394.361054:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1789518394.361063:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789518394.361100:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522779392 00000100:00100000:3.0:1789518394.361104:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522779392 00000100:00100000:3.0:1789518394.361136:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789518394.361143:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522779392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789518394.361164:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789518394.361205:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876445522779392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518394.361213:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789518394.361279:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1876445522779392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789518394.361492:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522779264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 459us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518394.361500:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518394.361766:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522779264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789518394.551833:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518394.869886:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518394.869920:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522779520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518394.870045:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518394.870288:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522779520 00000100:00100000:1.0:1789518394.870300:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522779520 00000100:00100000:1.0:1789518394.870377:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518394.870389:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522779520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518394.870421:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:1.0:1789518394.870517:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876445522779520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518394.870525:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518394.870798:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1789518394.870807:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e7441295f80, transno 8589934596 00000004:00080000:2.0:1789518394.870824:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1789518394.870860:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1876445522779520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789518395.574371:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518396.288353:0:20268:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1789518396.405792:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522779648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789518396.405896:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518396.405945:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518396.405952:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522779776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518396.405992:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518396.406040:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522779648 00000100:00100000:1.0:1789518396.406050:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522779648 00000100:00100000:1.0:1789518396.406111:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522779776 00000100:00100000:1.0:1789518396.406115:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522779776 00000100:00100000:1.0:1789518396.406135:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518396.406145:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522779648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789518396.406183:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789518396.406237:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876445522779648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518396.406257:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518396.406281:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518396.406287:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522779776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518396.406297:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789518396.406325:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876445522779776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518396.406331:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789518396.406349:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518396.406389:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e7441295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1876445522779776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518396.406402:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e74079d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1876445522779648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789518396.407920:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522780032:0@lo:400:kworker.0 00000100:00100000:0.0:1789518396.408004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518396.408052:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522780544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518396.408081:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518396.408100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522781056:0@lo:400:kworker.0 00000100:00100000:0.0:1789518396.408126:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518396.408151:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789518396.408157:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522779904:0@lo:400:kworker.0 00000100:00100000:0.0:1789518396.408191:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518396.408232:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522780416:0@lo:400:kworker.0 00000100:00100000:0.0:1789518396.408258:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518396.408278:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522780928:0@lo:400:kworker.0 00000100:00100000:0.0:1789518396.408301:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518396.408334:0:19074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780544 00000100:00100000:0.0:1789518396.408342:0:19074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780544 00000100:00100000:0.0:1789518396.408399:0:19074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518396.408410:0:19074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522780544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.410178:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780032 00000100:00100000:1.0:1789518396.410196:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780032 00000100:00100000:1.0:1789518396.410253:0:17830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780416 00000100:00100000:1.0:1789518396.410257:0:17830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780416 00000100:00100000:1.0:1789518396.410277:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518396.410287:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e743f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522780032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.414571:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876445522780032:12345-0@lo:400:kworker.0 Request processed in 4269us (6551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518396.414593:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518396.414668:0:17830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518396.414682:0:17830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522780416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.414751:0:17830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522780416:12345-0@lo:400:kworker.0 Request processed in 74us (6491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518396.414757:0:17830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518396.414805:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522780288:0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.414871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518396.414904:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522780800:0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.414928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518396.414952:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789518396.414959:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522780160:0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.414996:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518396.415015:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522780672:0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.415038:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518396.415053:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e743f9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522781184:0@lo:400:kworker.0 00000100:00100000:1.0:1789518396.415080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518396.415104:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518396.415659:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522781056 00000100:00100000:3.0:1789518396.415671:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522781056 00000100:00100000:3.0:1789518396.415724:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780928 00000100:00100000:3.0:1789518396.415728:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780928 00000100:00100000:3.0:1789518396.415744:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780288 00000100:00100000:3.0:1789518396.415755:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780288 00000100:00100000:3.0:1789518396.415770:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780800 00000100:00100000:3.0:1789518396.415772:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780800 00000100:00100000:3.0:1789518396.415783:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780672 00000100:00100000:3.0:1789518396.415785:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780672 00000100:00100000:3.0:1789518396.415795:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522781184 00000100:00100000:3.0:1789518396.415797:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522781184 00000100:00100000:3.0:1789518396.415812:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789518396.415819:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522781056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.415870:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876445522781056:12345-0@lo:400:kworker.0 Request processed in 52us (7743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518396.415876:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789518396.415892:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789518396.415898:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522780928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.415928:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876445522780928:12345-0@lo:400:kworker.0 Request processed in 31us (7627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518396.415934:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789518396.415946:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789518396.415951:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522780288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.415992:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876445522780288:12345-0@lo:400:kworker.0 Request processed in 30us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518396.415998:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789518396.416010:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789518396.416016:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522780800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.416041:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876445522780800:12345-0@lo:400:kworker.0 Request processed in 25us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518396.416046:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789518396.416063:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789518396.416068:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522780672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.416093:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e74079d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876445522780672:12345-0@lo:400:kworker.0 Request processed in 25us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518396.416098:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789518396.416109:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789518396.416114:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522781184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.416138:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876445522781184:12345-0@lo:400:kworker.0 Request processed in 24us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518396.416144:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1789518396.416177:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789518396.416181:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518396.416215:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876445522780672:0@lo:400:kworker.0 00010000:00080000:3.0:1789518396.416228:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f9b3100 x1876445522781184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518396.416240:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1876445522781184:0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.416251:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876445522780288:0@lo:400:kworker.0 00000100:00100000:3.0:1789518396.416259:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1876445522780800:0@lo:400:kworker.0 00000100:00100000:2.0:1789518396.416387:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522780416:0@lo:400:kworker.0 00010000:00080000:2.0:1789518396.416400:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e743f9b0700 x1876445522780928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518396.416411:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1876445522780928:0@lo:400:kworker.0 00000100:00100000:2.0:1789518396.416424:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1876445522780032:0@lo:400:kworker.0 00000100:00100000:2.0:1789518396.416436:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1876445522781056:0@lo:400:kworker.0 00000100:00100000:2.0:1789518396.416485:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522780160 00000100:00100000:2.0:1789518396.416489:0:18596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522780160 00000100:00100000:2.0:1789518396.416526:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518396.416533:0:18596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7303c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522780160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518396.416575:0:18596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7303c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876445522780160:12345-0@lo:400:kworker.0 Request processed in 43us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518396.416581:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789518396.416600:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518396.416618:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1876445522780160:0@lo:400:kworker.0 00000100:00100000:2.0:1789518396.417666:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445522779904 00000100:00100000:2.0:1789518396.417678:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445522779904 00000100:00100000:2.0:1789518396.417725:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789518396.417734:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e7441608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:3638:x1876445522779904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518396.417953:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e7441608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6224dd85-753f-4c3f-83da-7a6019473f75+24:3638:x1876445522779904:12345-0@lo:400:kworker.0 Request processed in 220us (9759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518396.417960:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789518396.418034:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6224dd85-753f-4c3f-83da-7a6019473f75:3638:1876445522779904:0@lo:400:kworker.0 00000100:00100000:0.0:1789518396.421503:0:19074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e743f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876445522780544:12345-0@lo:400:kworker.0 Request processed in 13048us (13373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518396.421523:0:19074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518396.421600:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e743f9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1876445522780544:0@lo:400:kworker.0 00010000:00010000:2.0:1789518396.600050:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518397.623001:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43139 lines, 43139 kept, 0 dropped, 0 bad.